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Step Response of an Adaptive 
Delta Modulator 


By W. M. BOYCE 
(Manuscript received May 6, 1974) 


N.S. Jayant has proposed a simple but effective form of adaptive delta 
modulation which uses two positive parameters, P and Q, to adjust the 
step size. The values P = Q = 1 describe linear delta modulation (LDM), 
and Jayant has recommended using Q = 1/P and 1 < P < 2. In this 
paper, we study the step response of this scheme for arbitrary P and Q. 
For each P and Q, we are able to define an integer n, the stability exponent 
for P and Q, such that the step response is unstable when P"Q > 1, at con- 
verges to the new level when P"Q < 1, and when P"Q = 1, it eventually 
settles into a periodic (2n + 2)-step cycle, for almost all initial conditions. 
For P = 2, and for some combinations of P and Q with P. between 1.6 
and 2, it 1s possible to have both PQ < 1 and P”Q 2 1, so that PQ < 1 
zs not sufficient for convergence. When a system 1s convergent, but a mint- 
mum step size 6 1s trmposed, the eventual periodic hunting will not neces- 
sarily resemble that of LDM, but will be bounded by 6P”. 


I. INTRODUCTION 


The basic concepts of delta modulation (pm) have been thoroughly 
discussed in several recent publications.!? In its simpler forms, delta 
modulation is a method of digitally encoding an input signal X = {2,} 
into binary pulses C = {c;} (where each c; = +1) so that an approxi- 
mation Y = {y;} of X may be reconstructed from the pulses C by a 
simple decoding scheme. The signal X, although presented to the 
encoder as a discrete-time sequence, will normally be a sampled (and 
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perhaps digitized) version of a continuous-time analog signal. The 
encoder works by comparing each xz; with y:-, through a feedback 
circuit to determine the sign of the subsequent pulse c;, according to 
the equations 


ci = sign (4%; — yi-1) 
mn; = cM, where MM; = | | > 0 
YE Yay ea 


Various forms of delta modulators differ primarily in the manner of 
determining the step-size M;; of course, since only the pulses C are 
to be transmitted to the decoder, what is required is a rule for deter- 
mining M/; from C. In conventional lznear delta modulation (LDM), 
the step-size M; is taken to be a constant 6, independent of the pulses 
C (and the signal X), so that each step m; = +6, resulting in the 
familiar ‘“‘staircase’’ appearance of Y under Lp. Since in this simplest 
form of pm, Y can change by only 6 per step, no matter how far 7; 1s 
from y;-1, Y has a very limited ability to keep up with X when X has 
a steep slope, which results in the condition known as slope overload. 
In contrast to LpM, adaptive delta modulation (ADM) permits M; to be 
modified depending on X, especially as the slope of the signal X changes. 
Since this relieves the slope-overload problem, such adaptation can 
result in better encoding, and several types of adaptive delta modu- 
lators have been described in the literature (for a survey, see Ref. 2). 

In this paper, we are concerned with the particular apm scheme 
devised by N. 8. Jayant,? and with certain generalizations of this 
scheme which arise naturally in the course of the investigation. 
Jayant’s one-bit-memory scheme has been characterized by Steele? as 
“instantaneously companded” (that is, having an ‘“‘instantaneous’’ 
adjustment of the step-size 7,), and Steele refers to Jayant’s ADM as 
“first order constant factor delta modulation.” The method is “first 
order,’’ since Jayant computes M; using only c;_; in addition to Mi_; 
and c;; the ‘‘one-bit memory” is used to save c;-1. When c; and cy; 
are equal, so that Y has not yet crossed X, there is a possibility of slope 
overload, so that 1; should be increased, and Jayant uses a ‘‘constant 
factor’ P 2 1 so that M; = PM,_; (and m; = Pmj:_1) when c; = c:i-1. 
To keep the step size from growing continuously with time, a second 
positive constant factor Q < 1 is chosen, so that when c; and c;_1 have 
different signs, indicating that Y has crossed X, the step size is reduced: 
M; = QMi-1, so m; = —Qm;_1. (Jayant concluded that values of P 
and @ with PQ = 1 gave the best performance on segments of speech, 
and he especially recommended P = 3 = 1.5, Q = 3.) We note that 
when P = Q = 1, we recover LpM, with M; = 6 and m; = +6 for 
all 2. 
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As even basic LpM has proved to be quite difficult to analyze (see 
Refs. 5 and 6 for some recent successful efforts), it is hardly surprising 
that there are few definite analytical conclusions concerning the 
behavior of Jayant’s ApM. This is confirmed by Steele’s comment that 
‘“‘An interesting feature of instantaneously adaptive [delta modu- 
lators | is their resistance to mathematical analysis: --.’’ Thus, in this 
paper, we restrict our attention to the comparatively simple problem 
of the step response of the approximating signal Y for Jayant’s ADM, 
where by step response we mean the ultimate behavior of Y when X 
assumes a constant value Z, 2; = # for all 7 = 7. 

For up, if X becomes constant, 7; = £ for 7 2 2, then Y will even- 
tually enter a “hunting”? phase having a two-step period in which 
adjacent values of Y bracket % (see Fig. 1); for some & and all 7 = O, 


Yr+oi = Ys < XL, 
Yeroi41 = Ye $62 EL. 


Thus, for tpM, Y will eventually get and remain no more than 6 away 
from a constant signal X, which is a very desirable characteristic. This 
approximation error, which occurs because Y is discrete and cannot 
exactly match a constant or slowly varying signal X, is called “‘granular 
error’ (or ‘quantization error’’), in contrast to the ‘‘slope-overload”’ 
error which results from the inability of Y to keep up with a steeply 
climbing X. For LpM, a one-time compromise between these two types 
of error must be made in the choice of the sampling rate and step-size 
6; then the granular error is known to be bounded by 4, but the slope- 
overload error can be severe for unexpectedly steep slopes. For apm 
the step size can be varied with the signal, thus reducing the slope- 
overload error, but nature and magnitude of the granular error is 
less understood than for the LpM case, a situation which it is hoped that 
this paper will help resolve. 

The question of the nature of the step response of Jayant’s ADM 
was briefly discussed by Jayant in Section 2.3 of Ref. 3, but his 
conclusions were limited to the finding that in contrast to LDM, the char- 
acteristics of the ‘“hunting’”’ phase of the ApM, particularly the mini- 
mum step size and maximum error, were very dependent on the mag- 





k k+1 k+2 k+3 k+4 k+5 


Fig. 1—Period-two (LpM) hunting. 
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nitude of the constant value £ (with yo and mo held fixed). Figure 2, 
taken from Ref. 8, shows the behavior for P = 3, Q = 3, yo = 0, 
my = 1, and & = 9, 10, 12. Steele’s analysis? showed that the four-step 
cycle exhibited in all three cases of Fig. 2 is exact and sustainable; as 
shown in Fig. 3, for some k and all 7 = 0, the cycle is given by 


Yeraj = Yr <2 
Yrpse1 = Ye +m < Ez 
Yrrsi-e2 = Ye +m(P+1)>z 
Yrrsi+3 = Ye + mP > &, 


where m = mMizi1 > O. Steele further indicated that this four-step 
periodic behavior is the typical ultimate step response of Jayant’s 
ADM when PQ = 1. He also concluded that PQ < 1 was necessary for 
Y to converge to X for a step input, but he did not provide a complete 
proof, and he did not claim that PQ < 1 was sufficient for the decay 
of Y to a constant x. (We note that when Y is in this four-step cycle, 
which is a ‘pure hunting” phase, the signal X is crossed only on alter- 
nate steps, and the signal value is typically not in the middle of the 
crossing step, calling into question assumptions used in Section IV 
of Ref. 3 and in Ref. 4.) | 

Even before the appearance of Steele’s work, experimental results 
and preliminary analysis had given rise to the general supposition that 


TIME ——* 


Fig. 2—PQ = 1 step responses (from Jayant’). 
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for a step Input, (2) Y would be unstable when PQ > 1 (as it was for 
Jayant’s speech data’), (27) that when PQ = 1, Y would ultimately fall 
into the periodic four-step cycle, but with very large hunting ampli- 
tudes possible, and (777) that for PQ <1, Y would converge to the 
constant £, with both step size and maximum hunting amplitude ap- 
proaching zero. (Although having the step size get too small is con- 
sidered undesirable in case X should begin to vary, it was generally 
thought that enforcing a well-chosen minimum step-size 6, as Jayant 
did in Ref. 3, would avoid this problem.):The question of convergence 
of Y for PQ < 1 is the most important of these, since as Steele and 
others have observed, using a value of PQ slightly less than 1, together 
with a minimum step size, would eliminate the problem of large- 
amplitude hunting cycles in Y during times when X was carrying no 
signal, while Jayant’s results’ indicate that for PQ < 1 but close to 1, 
the resulting penalty in signal-to-noise ratio during speech segments is 
negligible. 


Il. SUMMARY 


Our findings on the step response of a P, Q delta modulator confirm 
that for almost all initial conditions, Y will be unstable when PQ > 1, 
and will eventually fall into the four-step cycle shown in Fig. 3 when 
PQ = 1. (We say “almost all’’ because for each P and Q with PQ 2 1, 
there is a set W of initial conditions, negligible in the sense of Lebesgue 
measure, for which Y converges to X. In Fig. 2, there would be con- 
vergence for 4 = 11.1625, so that yo = 0, mo = 1, and € = 11.1625 is 
a point of W.) More importantly, we find that PQ < 1 is not sufficient 
to insure that Y will converge to a step input X. Rather, in addition to 
those values of P and Q with PQ < 1 for which Y converges to X, 
there are values of P and Q with PQ < 1 for which Y is unstable, and 
also some combinations for which Y is eventually periodic, with a 
period even and greater than four. However, our results establish that 





Fig. 3—Period-four apm hunting. 
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when PQ < 1 and etther P [= 1.6 or PQ = 1 — Q, which are the cases 
of most practical interest at present, then the PQ < 1 conjecture is 
true, and Y converges to a step-input X for all initial conditions. 

Our basic result is that for each P and Q, we can define an integer n, 
which we call the stability exponent for P and Q, such that the stability 
of the step response of Y depends not on the product PQ, as had been 
supposed, but on the product P"Q. Thus, for almost all initial condi- 
tions, Y is unstable if P"Q > 1, and is eventually periodic with period 
2n + 2if P"Q = 1; while for P*Q < 1 (or whenever the initial condi- 
tions fallin W), Y converges to X. The generally expected findings for 
PQ = 1 result from the fact that n = 1 when PQ = 1. 

It is useful to describe the stability exponent n in terms of P and 
PQ. If we define F,(P) = P(P — 1)/(P* — 1), then n is the stability 
exponent for P and Q if and only if Frii(P) S PQ < F,(P). Figure 
4 shows the graphs of F;,(P) for k = 1, 2, 8, 4. We see that F441(P) 
< F,(P) for P > 1, so that n is well defined, and that F44:(P) ap- 
proaches zero with increasing k. Thus, n becomes unbounded as Q 
approaches zero. 

The cases of most interest are those for which PQ < 1 and Y is not 
convergent, that is, when F,41(P) S PQ < F,(P) and P"Q 2 1. 
Since Frsi(P) S P-™, PQ 2 1 implies PQ = F,,4:(P), so the bind- 


| | | | 

| | | | 

| | 
| 

| | | | 

| | | 
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P 
Fig. 4—Domains of the stability exponent n. 
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PQ 





— —— — = = 





Fig. 5—Domains of unstable step response. 


ing constraints are that PQ < F,(P) and PQ = P-"* In Fig. 5 
those areas for which P-"+! < PQ < F,,(P) are shaded; they repre- 
sent those values of P and PQ for which Y is unstable for almost all ini- 
tial conditions. Looking particularly at the cases with PQ < 1, we see 
that when P S 1.6, Y is never unstable, but even such seemingly safe 
cases as P = 2, Q = 0.3 fall in the shaded region. As P is made larger, 
which might be useful in some applications, the combinations for 
which Y is unstable become dominant, so that for P = 4, not only 
those values of Q above { cause instability, but also all those between 
zs and i, as well as most values below 3. The basic point of these 
examples is, of course, that it is not PQ which determines the stability 
of Y, but PQ. 

The combinations for which P”Q = 1 are interesting in that their 
step response is a straightforward generalization of that of Jayant’s 
PQ = 1 avo. Specifically, if we first decide on the stability exponent 
n, choose a P 2 1 which satisfies 


prt — 2P»4+1>0, 


and then set Q = P-" so that P*Q = 1, we find that for almost all 
initial conditions, Y will eventually settle into a cycle of period 2n + 2 
steps. The PQ = 1 apm thus appears as the n = 1 member of this 


“ee 
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family, while L>M may be viewed as the n = 0 case: P°Q = Q = 1, 
with a 2-0 + 2 = 2 step period. For each n, the set of P which satisfies 
the inequality consists of an open interval (pr, +), where pn» in- 
creases with n and approaches 2 from below; (pn, + ©) is also exactly 
the interval of P for which Y can be unstable when the stability ex- 
ponent is n. Thus, when n > 1, the P"Q = 1 apm is feasible primarily 
for P 2 2, in contrast to the PQ = 1 apm, for which Jayant has con- 
jectured that 2 is an upper bound on the optimal P. These “‘high- 
response’? ADM may be useful for some applications, but we have not 
tested them against any data. They seem to offer yet another method 
of trading off granular error against slope overload. Of course, as 
for the PQ = 1 ease, one would actually set P"Q slightly less than 1, 
but large enough to preserve n as the stability exponent and thus insure 
convergence. 

As we have observed, the primary current interest is in combinations 
of P and Q for which Y converges to a step input X, so any practical 
system will provide for a minimum step-size 6. Thus, for a step input, 
the theoretically convergent Y will eventually encounter the minimum 
step size and become periodic, hunting about the constant <. We have 
considered the step response of a P, Q delta modulator with minimum 
step size and stability exponent n, and we find that the eventual 
periodic behavior is exactly that of a P, Q’ = P-* delta modulator 
with stability exponent k, where 0 S$ k S n and P > px, and where 
the value of & depends on the initial conditions. Thus, the hunting 
amplitude is bounded by 6P* S$ 6P”. Moreover, all those k for which 
0<sk sn and P > px occur for initial conditions having positive 
Lebesgue measure. In particular, when 1 > PQ 2 1 — Q, so that the 
stability exponent is n = 1, the four-step hunting cycle with range 
6(1 + P) cannot be rejected. Thus, Steele’s conclusion that the k = 0, 
LDM-type hunting is the only type that can occur when a minimum 
step size is imposed does not appear to be justified. 

Our investigations also shed some light on the question of recognizing 
when the slope-overload condition is occurring. Since in the limit for 
PQ = 1, the sequence is n “‘forwards,”’ one ‘“‘reverse,” ete., with only 
the nth forward crossing the signal, a sequence of » or fewer forwards 
should not be considered indicative of slope overload. But for n+ k 
forwards in a row, even if we decide to label & of them as slope over- 
load, it is not clear which k of them: first? last? middle? Perhaps the 
magnitude of the error must be considered as well as crossings. On the 
other hand, for P"Q = 1, distance alone cannot be used as the defini- 
tion since the amplitude of the hunting can be quite large, depending 
on the initial conditions. For P"Q < 1 with a minimum step size, much 
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the same considerations apply, except that in this case, the error 
magnitude would be very useful in recognizing hunting. 


Hl. ANALYSIS 


We assume that 2 2 0 for all z, and that “initial conditions” xo, yo, 
and mo are given. Since there are no bounds on X or Y, we may assume 
that € = 0, and that the ‘‘step’ in X occurs at 7 = 1, that is, that 
x; = £ = 0 fori 2 1. The effects of the previous history of Y and X 
can be summarized in the selection of yo and mo. The step response of 
Y for a P, Q delta modulator is then characterized by how well Y can 
approximate < = 0 as a function of the parameters P and Q and the 
initial conditions yo and mmo. 
Jayant’s ADM calculates Y from X by the following equations: 


Ci; = sign (4%; — Yi-1) 
Pri if C; = Ci-1 
n>; = ‘ 
—Qmi_1 if Co = —Cy-1 
Ys = Yi-1 TM. 


Since (2%; — Yi:-1), ci, and m; will always have the same sign, we may 
summarize the first two equations as 


Pmiy if (a; — yi_1) and m;_; have the same sign 


™Y—Qmi-1 if they have different signs. 


There is ambiguity in this definition, as the sign of zero is not defined ; 
that is, what value of c; is chosen when x; = y;_1? Our later analysis 
indicates that the proper choice is c; = —c:_, when 2; = yi-1, so that 
equality is considered to be a “‘crossing.’’? After making this conven- 
tion, and after observing that 2; = £ = 0 implies sign (7; — y:_1) 
= —sgsign (y:_1) for 2 2 1, we obtain the equations 


Mei = Pm, i y; and m; have different signs 
= —Qm,; if they have the same sign (or if y; = 0) 


Yisr = Yi + Miz. 


This is a two-state system whose state equations have a discontinuity 
at y; = 0, but we can transform it into a single-state continuous system 
if we note that the conditions on the comparative signs of y; and m; 
may be expressed as a condition on the sign of their ratzo, which is 
always defined since m; 1s never zero. 

We define the error-step-size ratio r; by r; = y;/m:. Then we have 


Tiga = Yisi/Mizr = 1 + yi/Meq1 
1+ (y:/m) (mi/miga) = 1 + ri(mi/mizd), 


| 
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where 


Mit. _ { P if y; and m; have different signs 
Mi; —Q if they have the same sign (or y; = 0) 
=4 pP if y;/m; = 7; < 0 
—Q if y:/m; =7; 2 0; 


so the state equation for the ratio may be written simply as 


Pett gies aes if r; <0 
ie 1—r:/Q if r;2 0. 


Thus, the sequence of ratios r; arises from repeated applications, be- 
ginning with ro = Yo/mo, of the function f(-) given by 


_sl+r/P it r <0 
TONG iG AE ge, 


This function is graphed in Fig. 6 for P = 3, Q = %. Note that f(-) 
is continuous at r = 1, and the continuity is not dependent on our 
choice of c; when 2; = y:-1, since f(0) = 1 simply says that y; = 2; 
+m; when 2; = y:-1, which is true no matter how one computes m; 
from m;-1. But an important observation is that a particular sequence 
of r;s computed from ris1 = f(r:), together with an initial step mmo, 
gives the complete sequence of m,’s, since a negative r; indicates 
m; = Pm;_1, while an r; which is positive or zero indicates m; = —Qmi_1. 
Thus, the convention on the sign of zero affects not the sequence of 
r;’s but the sequence of m,’s derived from it. 

We shall henceforth restrict ourselves to combinations of P and Q 
for which P > 1 and Q < 1, since this is the only case (other than 
P = Q = 1) that is suitable for practical applications. 

In our subsequent analysis we are primarily concerned with the 
function f(-), which describes how the ratio r; = y,/m; changes from 
one step to another. Since f(r) S 1 for all r, except for ro no r; can 





Fig. 6—The graph of f(r) and A for P = 3, Q = 3. 
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exceed 1. Thus, after the first step we are not concerned with the be- 
havior of f(r) for r > 1. 

We are not only interested in the change in the error-step-size 
ratio r; during one step, which is given by 7:41 = f(r.), but also in the 
change over two steps, three steps, etc. The change in the ratio over 
7 steps may be determined by applying the function 7 times, e.g., 
rig = fran) = fF (rd), ras = fF ))), ete. The function ob- 
tained by applying f(-) 7 times we call the jth iterate of f(-), which 
we write f?(-). Thus, we have r;i; = f%(r:), and by convention f!(r) 
= f(r) and f(r) =r. 

Since f(r) = 1+7/P 21++7r when P > 1 and r <0, when r is 
negative, the successive values of f?(r) will increase by at least 1 per 
step until finally one of the values f’(r) 1s nonnegative, that is, 0 S 
fi(r) S 1. This is just another way of saying that the signal Y will 
eventually cross zero on step yi,; beginning at r = r; < 0. But once 
f*(r) 1s in the interval [0,1], the next value of the ratio, namely 
f*(r), can be no smaller than f(1) = 1 — 1/Q, which we denote by gq. 
If f(r) <0, then the subsequent ratios will increase again 
until they reach [0,1], etc. Thus, the ratios can never escape the 
interval [g, 1] = [1 — 1/Q,1] = A once they enter, and we have 
proven: 


Theorem 1: If q = f(1) = 1 — 1/Q < O and A = [gq, 1], then for each 
r there 1s a 7 such that f(r) C A, and r; C A implies r, C A for all 
k = 1. 

So the ultimate behavior of the ratios is determined by the function 
f(-) and its iterates on the interval A = [q, 1 |, and thus by the graph 
of f(-) on the square A XA, denoted by the dotted lines in Fig. 6. 

We shall need more precise information on how many steps are 
necessary to go from a given ratio r to a zero crossing, or a nonnegative 
value of f%(r). We define a; = 0, ag = —P and, in general, ai41 = a; 
— Pé= — Yt_,P%* We further define Ao = [0,1], and A; = 
[aii1, a;) fort = 1. Since P > 1, this set of intervals forms a disjoint 
cover of the range (— ~, 1] of f(-). 


Theorem 2: If r € Aj, then 7 is the least integer such that fi(r) 1s non- 
negative, so that r € A; tf and only if r S 1 and exactly j steps produce a 
zero crossing of Y. Also, the sequence f(r) is increasing for O St Sj. 


Proof: Since f(aiz1) = a; for 7 = 1, it follows that f(Aii) = A; for 


121. Thus, if r C Aj, after 7 — 1 steps, f**(r) © Ai. Then, f(A) 
= [0,1) C [0,1] = Ao, so f(r) € [0, 1]. 


Corollary: For every ro = Yo/mo, the ratios eventually enter and remain 


mA. 
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Proof: For rS 1, we have f*(r) © [0,1] CA, while for r> 1, 
f(r) S 1s0 that f(r) € A; for some J, so that f*(r) € [0, 1]. 


We can now define n, the stability exponent for P and Q, as the largest 
value of 7 such that A; intersects A ; that is, it is the maximum number 
of steps from a ratio r in A to a zero crossing. Clearly, n is determined 
by the fact that g < 0, so that g © A, for some n > 0, and this n is 
the stability exponent. More explicitly, P and Q must satisfy 


Qn+1 = qd < dn 


or 


n n—1 
se Se! eee eee a ep De es 
j=l 


or 
n—1 

2 PIZzI/Q> DP? 
j=0 


To obtain the conditions cited in the summary, we invert and multiply 
by P to obtain 
Fiii(P) S PQ < F,(P), 
where 
PP Ay 


k-1 
F,(P) =P pa Pra] 


Another way of expressing this condition is 


Peet |e she ee | 


P= °O- Pea.” 





IA 


so multiplying by (P — 1)Q and adding Q gives 
PQ<P+Q-1Ss8 P29. 


Thus, the stability exponent 7 is the largest n such that P”Q is strictly 
less than the quantity P+ Q-—-— 1. Note that Q < 1 implies P7Q 
<P+Q-—1<P, so that P™"Q <1 whenever n is the stability 
exponent for P and Q. 


Theorem 8: If n is the stability exponent for P and Q, and P"Q < 1, 
then Y converges for all initial conditions, that is, both m; and y; tend 
to zero with increasing 1. 


Proof: Once the ratios enter A, no more than n negative ratios can 
occur without an intervening nonnegative ratio. Thus, as m; evolves 
by multiplication of P’s and (—Q)’s, each —Q can be grouped with 
at most n P’s with no P’s left over. Since P"Q < 1, the absolute value of 
m; will be decreasing by a factor bounded away from 1 at least every 
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(nr + 1) steps, and hence going to zero. Each time a ratio is nonnegative, 
which occurs at least once every (n + 1) steps, Y has just crossed zero, 
so y; must go to zero along with m;. 

The next theorem is the basic result of the theory of Jayant’s 
adaptive delta modulation. It states that not only is the stability ex- 
ponent n the maximum number of successive negative ratios that can 
occur once the ratios enter A, but that for almost all initial conditions 
(initial ratios 79), a sequence of n negative ratios all in A will eventually 
occur. (Here by ‘‘almost all”? we mean that the set of initial conditions 
for which this is false has Lebesgue measure zero—it can be covered 
by a family of open intervals of arbitrarily small total length.) This 
result is the key to the analysis for P"@ 2 1. 


Theorem 4: Let B, = A () An = [Q, an) and let B be the set of rE A 
such that fi(r) © Bn for some 7 (so that n successive negative ratios 
eventually occur). Then B is open (as a subset of A) and has Lebesgue 
measure u(B) = 1/Q = 1 — q, the length (and Lebesgue measure) of A. 
Thus, A\B (the points of A not in B) is a measurable set of Lebesgue 
measure zero. 


Proof: B, 1s open in A, and B can be written as 
B= U (rif() © Bal. 


Since each f‘(-) is a continuous function from A into A, each set in 
the union is open, so B itself is open. Thus, B and its complement 
A\B are measurable. Clearly, if S is a subset of B, and S’ is a subset 
of A such that f(S’) = S, then S’ is a subset of B also. In addition, 
if f(-) is linear with slope 1/s on S’, f(S’) = S, and S and S’ are mea- 
surable, then u(S’) = |[s|-u(GS). For each 7,0 S72 Sn, let B; = A; 
(1) B, so that each B; is measurable with measure p(B;). Now f(-) 
maps Ag linearly onto A, with slope —1/Q, so f(-) must map By 
linearly onto B, and w(Bo) = Q-n(B). Similarly, for each 7 such that 
n—-1>i>0, f(-) maps Aj linearly onto A; with slope 1/P, so 
f(-) must map B;,1 linearly onto B;, and p(Biz1) = P-p(Bi). When 
t= 0, f(-) maps A; linearly onto Ao\{1}, so »(Bi) = P-p(Bo\{1}); 
but since {1} has measure zero, u(B;) = P-y(Bo) also. Thus, for 
0<i1<n, we have »(B;) = P*-y(Bo). But since B is the disjoint 
union of the B;, we have 


w(B) = & (Bi) = w(B,) + E Pé-u(Bo) 
= (an — @) + w(Bo)- © Pi 
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Since »(Bo) = Q-y(B), and (?2) P* = 1 — an, 
#(Bo)/Q = (dn — g) + (1 — Gn)u(Bo) 


or 
#(Bo)(1/Q — 1 + Gn) = w(Bo) (an — g) = Gn — Gg. 


Since g < a, (this relies on the convention that mi: = —Q-m; when 
yi = 0), we have p(Bo) = 1, so n(B) = 1/Q = 1 — q = n(A). Thus 
u(A\B) = 0. 


Corollary: Let W be the set of real numbers r such that f'(r) € Bn for 
all 2, 1.e., once fi(r) 7s in A, no sequence of n successive negative ratios 
ever occurs. Then W has Lebesgue measure zero. 


Proof: Let Wy = A\B and for all 7, let W; be the set of r for which 
fi(r) © Wo. Since each f‘(-) is piecewise linear, each W; has measure 
zero, so W = Uo W: = {r| f'(r) © Wo for some 7} has measure zero. 
But since Wo is the set of r € A such that fi(r) € B, for all 7, W is the 
set of (unrestricted) r such that f(r) & B, for all 7. 


We note that W is nonempty for all P > 1 and Q < 1, since f(-) 
has a fixed-point w = Q/(Q + 1) € (0, 1), and w and all its preimages 
(r such that f‘(r) = w for some 7) will be in W. In addition, for all 
7 = 2, f*(-) will have fixed points in addition to w, and many of these 
fixed points and their preimages will be in W also. 


Theorem 5: With n the stability exponent for P and Q, on An=[@n41, Gn) 
the function f"*)(-) ts linear with slope — (P"Q)— and has a fixed point 
A es La, An) = B,. | 


Proof: Since f(Aii1) C A; and f(-) is linear on each A;, f?(-) is linear 
on each A; for 7 S$2+1. Clearly, f*(an41) = 0 and f*(a,) = 1, so 
f?7(anu1) = 1 and f*“(a,) = f(l) =q=1-1/Q. The slope of 
fr*'(-) on Anis thus (¢ — 1)/(@n — Gny1) = (—1/Q)/P” = —(P7Q)7. 
Since g € A» by definition, g = f**" (an) < an, but since f**1(-) has 
negative slope, f**¥(q) > f** (an) = q. Thus, f*(q) > q, ft (an) 
< dn, and so f"*t1(-) has a fixed point z between gq and ap. 


Theorem 6: If P*Q>1, then f?*!(B,) C Ba, that is, if r;EBnr=[q, an), 
then rit¢nairys € Bn for all k 2 O. Thus, except for ro € W, the ratios 


eventually enter B, and return to B, every n + 1 steps thereafter. More- 
over, the ratios falling in Bn converge to the fixed point z of frt!(-). 


Proof: f?*!(an) = q, and the absolute value of the slope of f**#(-) on 
An is (P*Q)? <1 so |f*"(@ — fr(an)| < |q—an| and so 
FO Br) = (Gy POI C (Gan) C Ba. Hach ft?*(B,) is an in- 
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terval containing z, and each increase in k (each n + 1 steps) reduces 
the length of the interval by a factor (P"Q) < 1, so for each r € B,, 
we have f("t)*(r) approaching z with increasing k. Thus, except for 
initial conditions in W, the ratios not only eventually enter B, (by the 
corollary to Theorem 4) but return there every n + 1 steps, each time 
coming closer to 2. 


Corollary: If n ts the stability exponent for P and Q and P"Q > 1, 
then for all initial conditions which are not in W, the signal Y 1s un- 
stable. Also, if r;E Bn, then M;,;>M:; for all j>0, where M;=|m,|\. 


Proof: Once r; is in Bn, every n + 1 steps M; increases by a factor of 
PQ > 1; hence the step size increases without bound. 


The next theorem and its corollary establish the nature of the stable, 
periodic step response which is characteristic of the Jayant family of 
delta modulators. 


Theorem 7: If n ts the stability exponent for P and Q and PQ = 1, 
then f?™+2(-) zs the identity on Bn, and if y; and m; are such that r; 
= y:;/m; € Bn, then whenever 7 271, k 2 0, and 1 = (2n+ 2)k, we 
have Yj41 = y; and mj11 = m;, so that Y becomes periodic with period 
2n + 2 steps. Thus for all initial conditions which are not in W, Y 
eventually setiles into a periodic (2n + 2)-step cycle. 


Proof: If P"Q = 1, then the slope of f"*1(-) is —1, so that f""1(q) = a, 
in addition to f**(a,) = q. Thus, f?"*?(a,) = an, f?"?(q) = qg, So 
f?(-) is the identity on [g, a, ] and hence on B, = [4@, an) itself. 
Thus, when 7; © Ba, rjrenge2 = 73. But by Theorem 2 we know that 
among the 2n + 2 successive values of rj,; there are 2n negative ones 
and 2 nonnegative ones, so that mMjsony2 = P?"(—Q)?m; = (—P"Q)?m; 
= m;. Thus, Yjren42 = y; as well. The connection with W is made as 
in previous theorems. 


Theorem 8: If P"Q = 1 and ro € W, then y; and m; both converge to 
O, 2.e., for initial conditions in W, Y is neither unstable nor periodic but 
converges to X. 


Proof: For all initial conditions, the ratios eventually enter and remain 
in A, but if 77 € W, then all ratios in A fallin the A; withz < n. Thus, 
at most, n — 1 successive negative ratios can occur; hence, each —Q 
can be grouped with no more than n — 1 P’s with no P’s left over. 
But PQ < 1 for 7 < n even if P"Q > 1, so at intervals of no more 
than n steps m; will be reduced in absolute value by a factor bounded 
away from 1; hence m; will converge to zero, and with it Y, since a 
zero crossing will occur at least every n steps. 
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We can now relate our findings to the general supposition on the 
stability of Jayant’s delta modulator: that is, that the system is un- 
stable, periodic, or convergent according to whether PQ exceeds, 
equals, or is less than 1. We see that the general supposition is in fact 
correct when PQ 2 1— Qandm €& W. 


Theorem 9: If PQ = 1 — Q, then the stability exponent for P and Q 
is 1. Thus, Y converges to X when 1 ~ Q S PQ <1 (or when PQ 2 1 
and ry) € W), settles into a four-step cycle when PQ = 1 and ro E W, 
and 1s unstable when PQ > 1 and ro E W. 


Proof: All we must show is that g = 1 — 1/Q 2 a. = —P, so that 
q € Ay. But dividing 1 — Q S PQ by —Q yields q 2 —F as required. 
The rest follows from our earlier theorems, taking n = 1. 


The most unexpected results of our analysis are the existence of both 
unstable combinations of P and Q with PQ < 1 and Jayant-type delta 
modulators that satisfy P"Q = 1 and are eventually periodic with a 
2n + 2 step period when n > 1 (and 7o € W). The next three the- 
orems establish that since n depends on P and Q, in order to attain 
PQ = 1 we must have P > pn, where pi = 1, po & 1.62, pi < piss, 
and lim;..p: = 2. Thus, for P = 2, all values of n are realizable, 
while for P S po 1.62, only the n = 1 value will allow P"Q 2 1. 
(The sequence {p;} that we define here comes up again in our subse- 
quent analysis of a P, Q delta modulator with a minimum step size.) : 


Theorem 10: If P*¥Q 2 1, then q = azy1, So the stability exponent for 
P and Q = P-* cannot exceed k. 


Proof: Since q = 1 — 1/Q 2 1 — P*, all we need show is that 1 — P* 
= Ary. = — DF, P*, or P* S Yohey P*, which always holds. Thus, 
ifg € An = [a@n41, Gn), then dn > ¢ 2 Gu4180n Sk. 


Theorem 11: We can choose a Q such that P"Q 2 1, where n 1s the 
stability exponent for P and Q, tf and only if P satisfies P"t! — 2P” 
+1> 0. Equivalently, n is the stability exponent for P and Q = 
P-" (PQ = 1) af and only if P™*1? — 2P" + 1> 0. 


Proof: If. P"Q = 1, then gq = 1—1/Q 21 -— P”. By the definition 
of il — PSs ¢ 4,= =] > 431 Piso P* Sai = 1) 
(P —1). But then P*(P — 1) = Pe" — P* > P™—1, and Pr 
— 2P7 +1 > 0. Since each of these steps can be reversed, if P*" 
— 2P*+1>0, then setting Q = P-*, we have gq < ax, son2 k. 
Since q is strictly less than a; and dq/0Q > O, there is an open interval 
of values of Q = P-* for which n 2 k. But by Theorem 10, n Sk 
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when P*Q 2 1, so for these values of Q we have n = k and P"Q = 1 
or P"Q > 1, respectively. 


Theorem 12: For each k = 1, let @, be the set of P > 1 which satisfy 
Pet! — QP*+- 1> 0. Then, each @;, is an open half-line (px, + ©), 
where Dr < Drsi < 2 and limysaoDe = 2. 


Proof: For k = 1, the requirement is simply that (P — 1)? > 0, so 
pi= 1. For k 2 2, differentiating g(P) = P**1 — 2P*+1 gives 
g’(P) = (k + 1)P* — 2kP*, whose only zero besides P = 0 is 
P = 2k/(k + 1), which lies between 1 and 2 and approaches 2 with 
increasing k. Since g(1) = 0, g’(1) = 1 — k < 0, and g(2) = 1, g(P) 
has a zero pz between 2k/(k + 1) and 2, and g(P) > 0 for P 2 2. 
Thus, P > p; implies g(P) > 0, and 1 < P < px implies g(P) < 0. 
Since 2k/(k + 1) < p; < 2, px approaches 2 with increasing k. Since 
g(prri) = pr —1>0, pes > pe, so the sequence {p,} converges 
monotonically to 2. 


In fact, since g(2) = 1 and g’(2) = 2*, a good approximation for 
p, is 2 — 2-*, For k = 2, 3, 4, the approximations are 1.75, 1.875, 
1.9375 and the actual values 1.6180, 1.8393, 1.9275. 

We have previously observed that the periodicity that occurs when 
PQ = 1 is undesirable in practical systems, since it may result in Y 
having significant power when X is zero or close to it. This problem is 
aggravated by the fact that the amplitude of the periodic hunting is 
unpredictable and can be quite large. To overcome this problem, 
Steele and others have suggested setting PQ slightly less than 1, so 
as to make the Y converge to X, and using a minimum step size, which 
we call 6, to prevent the step size from getting so close to zero during 
long stretches of zero (or constant) signal X that Y cannot quickly 
respond when X begins to vary. Indeed even when studying the case 
PQ = 1, Jayant used a minimum step size, although it was seldom 
binding (see Fig. 3 of Ref. 3). 

In our final three theorems we treat the case of a P, Q delta modula- 
tor with a minimum step-size 6, so that when M; < 6/Q and a zero 
crossing occurs, instead of the next step having magnitude Mi41 
= QM; < 6, we set Mix1 = 6. Thus, MW; = 6 for all 2. We note that if 
Y would be unstable or periodic in the absence of a minimum step 
size, then the step sizes may never be reduced to the point that the 
minimum becomes binding. If a step of size 6 does occur, however, 
with M; = 6 and ri. € [0,1] = Ao, we show that Y eventually 
becomes periodic with a 2/ + 2 step cycle, where 0 < J Sn (the 
stability exponent for P and Q) and P > pz; with the exception of the 
case P"7Q > 1, 7; © Bn, C An, for which Y is unstable and a step of 
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size 6 never reoccurs. Thus, in contradiction to Steele’s conclusion, 
the step response of a P, Q delta modulator with minimum step size 
does not reduce to the Lp case, but is fully as complex as the P"?Q = 1 
case with no minimum. However, it is true that if P"Q <1, or P"Q 
= 1 and ry € W, the minimum step size will eventually occur and the 
hunting amplitudes be thereafter bounded by P’6. 


Theorem 18: If ri <0, then ris1 = f(ra; of ri 2 0 and M; 2 5/Q, 
then risi1 = f(ri); and of r; 2 O and 6 S M; < 8/Q, then f(ri) < rigt 


< 1. Thus, for all initial conditions, r; € A for some 1, and if r; C A 
thenr; € A for allj 2 1. 


Proof: When r; S 0, we have mis1 = Pm;, so the minimum is not 
relevant, and when r; 2 0 and M; 2 6/Q, we have mix1 = —Qm,, so 
the minimum is not binding. Thus, for these cases, ri41 = f(ri). But 
when 7; 20 and M; < 6/Q, we have f(r:) =1—7:/Q but risi 
= Yisr/Migt = 1+ (mi/migs) (ys/mi) = 1+ (mi/miz1) ri. Since mi/miz1 
<0, we can write this riz1 = 1 — (Mi/M;i41)7;:. But Misi = 6, 
M; < 6/Qs0 Mi/Mis1 < (6/Q)/6 = 1/Q,0 S 1 = rig = ri(Mi/M i 41) 
< r:/Q, and sol 2 rin1 > 1 — 7:/Q = f(r:). Thus, the evolution of r; 
for r; < 0 is given by f(-), sor; €& A and r; < 0 implies riz1 € A; 
while if r; € [0,1], ¢ S f(r) S rena S lsorizs € A in this case also. 


For the next two theorems, we assume that a minimum step size 
has occurred, with M; = 6, and that r;_1 € Ao so that r; C A. Since 
r; © A, we must have r; € Ay for some J,0 SJ Sn, where n is the 
stability exponent for P and Q. For almost all cases of interest, steps 
of size 6 will continue to occur at least every J steps, and Y will be 
periodic; the sole exception, which we dispose of first, is when P*Q > 1 
and J = n, in which case Y is unstable and a step of size 6 never 
reoccurs. 


Theorem 14: If M; 26, r;€ Af) An = Bn, and P"Q > 1, then 
Trigg = fi(ri) and Mj,; > 6 for all 7 > 0, so that Theorem 6 and its 
corollary apply and Y 1s unstable. 


Proof: If M; 2 6 and r; © Ba, then by Theorem 18, ripn = f"(1i) 
© Ao, and Miz, = P"M;. But P*Q>1, so Mizn > M;:/Q = 6/Q, 
and M ipn41 va OM inn — P°QM; = d6P"Q > O. Thus, Titns1 = f-7(r,) 
= Ba, M is nga = 6P7Q, and so Tit(n+1)k _ Br and. M sp cntye = 6(P7Q)* 
for all k = 0. 


The next theorem characterizes the ultimate behavior of the P, Q 
delta modulator with minimum step size for the more interesting cases 
—those not covered by Theorem 14. Thus, we assume that W/; = 6 
and r; © A, with r; € Az, where P’Q < 1. Without loss of generality, 
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we choose signs so that m; = M; = 6 and y; — 6 = yi_1 S O (we con- 
tinue to assume Z = QO, 1.e., X is identically zero). Since r; C As, we 
have rizy € Ao 80 Tit yi1 € Ax for some K, 0 S K Sn. To simplify 
the notation, we set 1 = 2/ + 2. 


Theorem 15: If me = 6, 7; EC Af) As, PYQ S 1, and ritzy, C Ax, 
then K SJ. If K = J, then P > py, and Yist = Yiy Mizt = Mi, and 
Y is pertodic with period 2J + 2 and maximum amplitude 6P! S 6P". 
Moreover, for each j such thatO Sj7 Snand P > p;, the set of initial 
conditions which produce a (27 + 2)-step period has positive Lebesgue 
measure. 


Proof: When J 2 2, we have yui = yi + 6P <0, mizi = 8P3 Yire 
= y; + 6(P + P?), mize = 6P*; and, in general (even for J = 0, 1), 
we have yas = yi t 6 32, P? 20, miz = 6PY. Since PYQ Sl, 
6PY S 6/Q so that mizz41 = —6. If K 2 J, then 


J 
Yi-141 = Ys — 4 2. Pi=y—6 = yin SO, 
me 


so that K S$ J; thus, K 2 J implies K = J, so we have proven that 
K s J.lf K = J, then we have seen that y:_141 = yi-1; also, Miz1 = 4 
since M:141 = —6P% and PY < 1/Q. Thus, yixr = yi-ryr + 6 = Yi-1 
+6= y;,and m:,; = 6 = m;, so Y is periodic with period 1 = 2J + 2. 
To show that P > py; when K = J and Y has period / = 2J + 2, we 
observe that by the definition of J and K (=) we have (see Fig. 7, 


}65 


x! 
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Fig. 7—Period-eight apm hunting with minimum step-size 6. 
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with J = 3) 
Yizs—-1 < O, Yizs = O, 
Yi-241 > O, Y¥i141 S 0, 


so that 
J—1 ; 
Yits-1 = Yirt 6 2 Pi <0 
a 
Yiwu. = Yi-unt +t OPY = yi_s + 6PY > O, 
so that 
J-1 
Yi-1 + 6 X p? < Yin + 6P!, 
j= 
so 
PJ —1 
Be J 
Bear 
from which 


Pa 2 = 1 U, 


But this is the defining condition for P > pr. To show that each 7 
satisfying 0 S 7 S n and P > p; comes up with positive measure, it 
is only necessary to observe that choosing yo, mo such that 6 S —mpo 
<6/Q and 


J—1 
—§P <y < —8 ¥ Pi 
; j=l 


will realize the 2J + 2 step period analyzed above with7z = 1. 


We note that once a minimum step occurs, the series of ‘‘reversal 
numbers” (of which the J and K are two adjacent elements) is mono- 
tone decreasing (K < J) until it repeats itself (AK = J), after which 
it is constant, and Y is periodic. This monotonicity holds only after 6 
occurs; when there is no minimum step size, there is no monotonicity, 
except that when P"Q 2 1 an occurrence of J = n will result in 
nothing but n’s thereafter. What we have shown is: 


Corollary: If 67s the minimum step size and M; = 6wherer; © A () A;, 
then unless P"Q > 1 and 7 =n, within (7 + 1)? steps Y will become 
periodic with period 2J + 2, whereO SJ S7. 


Proof: Until the reversal numbers become constant, at least every 
7 + 1 steps a new, lower reversal number occurs, and there are only 
7 + 1 possible such numbers; thus, within (7 + 1)? steps the minimum 
number J is obtained and Y is periodic. 


392 THE BELL SYSTEM TECHNICAL JOURNAL, APRIL 1976 


IV. ACKNOWLEDGMENTS 


Special thanks are due to 8. J. Brolin for a critical reading of the 
original manuscript and valuable suggestions on the most useful 
interpretation of the analytical results. The encouragement and helpful 
comments of N. 8. Jayant and D. J. Goodman are also gratefully 
acknowledged. 


REFERENCES 


1. H. R. Schindler, ‘‘Delta Modulation,’’ IEEE Spectrum, October 1970, pp. 69-78. 

2. R. Steele, Delta Modulation Systems, New York: John Wiley, 1975. (Especially 
pp. 248-251 of Chapter 8.) 

3. N.S. Jayant, “Adaptive Delta Modulation With a One-Bit Memory,” B.S.TWJ., 
49, No. 3 (March 1970), pp. 321-342. 

4. N.S. Jayant and A. E. Rosenberg, ‘“The Preference of Slope Overload to Granu- 
larity in the Delta Modulation of Speech,” B.S8.T.J., 50, No. 10 (December 
1971), pp. 3117-8125. 

. D. Slepian, ‘On Delta Modulation,’ B.S.T.J., 57, No. 10 (December 1972), pp. 
2101-2137. 

. A. Gersho, “Stochastic Stability of Delta Modulation,” B.S.T.J., 51, No. 4 (April 
1972), pp. 821-841. 


o> Or 


ADM STEP RESPONSE 393 


Copyright © 1976 American Telephone and Telegraph Company 
THE BELL SysTEM TECHNICAL JOURNAL 
Vol. 55, No. 4, April 1976 
Printed in U.S.A. 


On the Design of All-Pass Signals With 
Peak Amplitude Constraints 


By L. R. RABINER and R. E. CROCHIERE 
(Manuscript received November 24, 1975) 


In this paper, the problem is discussed of designing a signal other than 
the standard impulse function to be used to test a digital system of limited 
dynamic range. The constraints on such a signal are that it must be all- 
pass, of limited duration (approximately), and peak-amplitude-lamited 
so as to utilize the limited dynamic range of the system as far as possible. 
Stated another way, the goal 1s to spread out the energy in the signal as 
much as possible to reduce its peak amplitude and therefore to be able to 
pass higher energy signals through the system without clipping them. The 
class of all-pass signals (obtained as the impulse response of a variable 
order all-pass filter) was investigated for use as the test signal. The parame- 
ters of the all-pass filter of a given order were optimized to give an all-pass 
signal whose peak amplitude was the smallest possible. Filter orders from 
first to eighth order were designed and investigated. It was found that 
reductions tn the peak signal level of up to 11.2 dB (relative to the signal 
level of an equivalent energy impulse) could be obtained for an eighth-order 
all-pass signal. Interpolated versions of these all-pass signals showed that 
the peak value of the interpolated waveform was only on the order of 6 dB. 
Thus, the use of an all-pass signal, rather than the standard impulse, for 
testing a digital system can result in about 1 bit extra dynamic range. 


I. INTRODUCTION 


The problem of designing digital signals for testing (e.g., evaluating 
the impulse response) digital systems is one which has received very 
little attention in the digital signal-processing literature. This is be- 
cause the impulse function 1s used as the standard test signal for most 
systems. Although the impulse function is suitable for this purpose in 
a wide variety of digital systems, there are cases in which the use of 
the impulse function leads to problems. Generally, such systems are 
those that have limited dynamic range—e.g., digital hardware im- 
plementations of a system, or fixed-point, finite, precision, software 
implementation of a digital system. In this paper, the problem is con- 
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sidered of designing signals other than the standard impulse function 
to be used to test digital systems of limited dynamic range. 
The desirable features of a test signal for digital systems are 


(2) It must be an all-pass signal in that it must be capable of testing 
the system (1.e., determining the frequency response of the 
system) for any admissible frequency. 

(2t) It should be of limited duration. 
(ait) It should be peak-amplitude-limited, to give the maximum 
utilization of the limited dynamic range of the system. 


The above features define a desirable test signal as one whose energy 
is spread out as much as possible to reduce the peak signal amplitude 
and therefore be able to pass higher energy signals through the system 
without clipping. 

If we let x(n) denote the test signal, then the requirements described 
above can be related to x(n) and X(e%”), the Fourier transform of 
x(n), in the following manner. For the signal to be all-pass implies 


| X (e%) | = C, all w, (1) 


where C is an arbitrary constant value. If we let C = 1, then by 
Parseval’s theorem we have 


27 0 
sz [1X @*) ldo = 1 = ¥ a(n), (2) 
27 0 n=0 
1.e., the overall energy of the test signal is unity. For the signal to be 
of limited duration (at least approximately) requires 


Nii 


py x(n) = y¥, (3) 


where y & 1 and N, is the signal duration in samples. (The constraint 
of (3) has not been used directly in the work presented here, since it 
was found that it was satisfied by all the signals that were designed.) 
Finally, the constraint that the peak signal amplitude be as small as 
possible requires that max, |x(n)| be minimized over the design pa- 
rameters of the signal. 

Besides the standard impulse function, the only other class of signals 
that 1s appropriate for a test function (i.e., that has the set of features 
described above) is the set of all-pass filter impulse responses. Such 
signals can be optimized to meet the design requirements by varying 
the parameters of the all-pass network to minimize the peak signal 
amplitude. 

The purpose of this paper is to discuss the issues in the design of all- 
pass signals to be used to test a digital system. In Section II, the design 
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methods used to optimize these all-pass signals are discussed. In 
Section III, considerations dealing with the interpolation of the result- 
ing all-pass test signals are given. Finally, in Section IV a brief discus- 
sion of the effects of filtering these all-pass signals is given. 


Il. DESIGN TECHNIQUES FOR ALL-PASS SIGNALS 


The signal design problem is one of choosing the parameters (the 
filter coefficients) in the implementation of an Nth-order all-pass filter 
to minimize the peak amplitude of the resulting impulse response. For 
the actual implementation of most all-pass filters, 1t is generally con- 
venient to consider the cascade realization which is of the form 


Ns 
X@) = IL H:@), (4) 


where N, is the number of sections in the cascade and H(z) are the 
individual sections, which generally are either first-order or second- 
order sections. A first-order all-pass section has the system function 


H(z) = Tate (5) 


1 — az’ 


whereas a second-order all-pass section has the system function 


Hye) = oe (6) 


— ¢;27} +- 6,27? 


The design problem is thus to choose the all-pass parameters (a, bi, ci) 
to minimize the peak signal amplitude in the impulse response of the 
filter. 

For the first-order case, the parameter a can be analytically de- 
termined. In this case, the difference equation 1s 


x(n) = uo(n — 1) — auo(n) + ax(n — 1), (7) 
where 
zz, Wek n=0 
on) = Fe otherwise, 

or 

x(n) = 0 n<Q 

z(0) = —a 

o(l) = (1 — a?) 

z(n) = (1 — a@)a™, n = 2. 


Since |a| < 1 for stability, it is seen from (8) that the largest possible 
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samples are x(0) and x(1). Thus, to minimize the larger of |r(0)| and 
|2(1)| requires a choice of a such that 


[x(0)| = |x(Q)| (9) 


or 
| Omin | ee |1 _ Grin: (10) 


The solution to (10) gives amin = 0.618. 

For optimization of higher-order all-pass filters, no analytical solu- 
tion could be found. Thus, an optimization method was used to obtain 
the desired solutions. In particular, a nonlinear unconstrained optimiza- 
tion method developed by Powell! was used in which the evaluation 
of derivatives was not required. The maximum peak amplitude of the 
all-pass signal can be minimized by minimizing the function 


@ = tim |X elo] (11) 


In practice, however, the function of (11) is not unimodal or smooth, 
and thus it is not practical to find the optimum choice of parameters 
without a good starting point (initial choice of parameters) for the 
optimization routine. To obtain such starting points, (11) was used as 
the objective function for a value of p = 4. A variety of randomly 
chosen starting points was used to obtain the best solutions for p = 4. 
The p = 4 solutions were then used as starting points to determine the 
optimum p = © solutions. 

The parameters that were varied within the optimization program 
were the 0,’s and c,’s of the second-order sections within the cascade 
and the a for a first-order section (used whenever the order of the 
all-pass filter was odd). The advantage of using the cascade realization 
is that it is simple to ensure stability of the resulting filter. Additionally, 
instabilities occurring during the optimization program because of 
poles drifting outside the unit circle were easily detected and cor- 
rected with minimal computational effort. 

Using the Powell optimization method, the optimum all-pass signals 
of order 1 to 8 were designed. Table I gives values of the optimum 
all-pass filter parameters and the resulting peak signal level for each 
of these cases. It is seen in this table that the peak signal level falls 
from 0.618 to 0.275 as the all-pass filter order varies from first to 
eighth order. Further, it can be seen that progressive increases in the 
order of the all-pass filter result only in very modest reductions of the 
peak signal level beyond a second-order filter. Figures 1 and 2 show 
the positions of the poles and zeros of the optimum all-pass filters and 
their group delay responses for each of the filters of Table I. 
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Table | — Filter coefficients for optimum all-pass filters with peak amplitude constraints 


Filter Maximum 
Order Signal Level . Os o bs me bs C3 bs C4 
1 0.618 0.6180 — — — oo — — — — 
2 0.500 — 0.5 1. — — — — — = 
3 0.428 0.8698 0.4915 0.6961 — — — — — — 
4 0.386 — 0.8008 0.5137 —0.4823 0.3491 — — — == 
5 0.3380 0.6734 0.6081 0.4462 0.7996 — 0.5253 — — — = 
6 0.3183 — 0.6151 1.4640 0.8228 0.3748 —().6290 0.0197 — — 
7 0.2895 —0.5183 0.8339 — 0.4254 0.7668 1.5407 0.8735 0.4700 — — 
8 0.2748 — 0.8149 1.2308 — 0.4970 —0.1060 0.8621 —0.21385 0.7870 1.5727 


Ist ORDER 2nd ORDER | 


(a) (b) 


3rd ORDER 4th ORDER 


(c) e 


5th ORDER P 








8th ORDER 


3 
°o 


Fig. 1—Positions of the poles and zeros of the optimized all-pass signals of order 
1 to 8. 





An interesting property of this class of signals is that the optimum 
all-pass filter is not unique. This result is readily seen since the simple 
replacement of z by 27! in the z transform leads to a multiplication of 
the signal by (—1)*, which does not affect the signal magnitude at all. 
Thus, each pole and zero of Fig. 1 could equally be shown reflected 
about the imaginary z axis and still be a valid optimum solution. 
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Fig. 2—Group delay responses of the optimized all-pass signals of order 1 to 8. 


lll. INTERPOLATION OF THE OPTIMUM ALL-PASS SIGNALS 


The results of the preceding section indicate that reductions in the 
peak level of the optimized all-pass signal on the order of 4 to 1 can be 
obtained with an eighth-order filter. This result can be somewhat mis- 
leading, however, since the continuous waveform (from which the 
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signal samples could be derived) could peak up between samples—i.e., 
the actual reduction in signal level could be a fortuitous result obtained 
by sampling the waveform at the most opportune sampling intervals. 
If this were the case, and the test signal was used as input to a network 
which approximated a noninteger delay, the output signal could be of 
higher amplitude than the input signal simply because of the interpola- 
tive properties of the network. 

To investigate the true peak amplitude of the continuous waveform 
associated with the test signal, each of the eight test signals of Table I 
were interpolated using a 20-to-1 interpolator implemented using the 
methods described by Crochiere and Rabiner.?? Figure 3 and Table II 
show the results of interpolating the test signals. Figure 3a shows both 
the test signal samples as well as the interpolated waveforms (dotted 
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Fig. 3—Samples and interpolated waveforms of (a) the all-pass signals for orders 
1 to 8 and (b) the all-pass signals modulated by (—1)". 
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Fig. 3 (continued). 


lines) associated with the signals. Figure 3b shows the alternate set of 
peak-limited waveforms formed by multiplication of the signals in 
Fig. 3a by (—1)”. Although each test signal attains its peak amplitude 
at a number of different sampling instants, its interpolated waveform 
generally shows a distinct maximum amplitude. Table II also shows 
that the peak interpolated waveform amplitude ranged from 0.766 for 
the first-order signal to 0.421 for the seventh-order signal. Thus, in 
terms of the interpolated waveform, on the order of a 2-to-1 reduction 
in peak signal level was obtained for these test signals. 

One more observation can be obtained from Fig. 3 and that is that 
the test signals, although generated as the output of a recursive struc- 
ture, damp out in level extremely rapidly and could be considered 
finite duration signals. It was found that 128 samples of the test signal 
were sufficient for obtaining 16-bit test signals to full 16-bit accuracy. 
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Table I|— Comparison of signal level of peak-limited signals to a unit sample, all with unit signal energy 

a . Waveform (Interpolated) of Waveform (Interpolated) of Peak- 

Filt Peak-Limited Signal Peak-Limited Signal Limited Signal with (—1)* Modulation 

ilter 

Order 

Max. Min. Ratio ae Max. Min. Ratio oo Max. Min. Ratio eae 

1 0.618 —0.618 0.618 —4.18 0.766 — 0.633 0.766 —2.32 0.377 —0.924 0.924 —0.68 

2 0.500 —0.500 0.500 —6.02 0.595 — 0.522 0.595 —4,52 0.533 —0.501 0.533 — 5.46 

3 0.428 —0.428 0.428 —7.37 0.465 — 0.632 0.632 —3.98 0.545 —0.502 0.545 —5.27 

4 0.375 —0.386 0.386 —8.27 0.505 —0.627 0.627 —4.06 0.586 —0.391 0.586 —4.65 

5 0.338 — 0.334 0.338 —9.42 0.526 —0.391 0.526 —5.57 0.474 —0.503 0.503 —5.97 

6 0.301 —0.318 0.318 —9.95 0.585 —0.345 0.585 —4.65 0.525 —0.442 0.525 —5.60 

7 0.290 —0.290 0.290 —10.75 0.497 — 0.367 0.497 —6.07 0.338 —0.457 0.457 —6.79 

8 0.273 —0.275 0.275 —11.21 0.544 —0.313 0.544 —5.29 0.387 —0.421 0.421 —7.51 


IV. APPLICATION OF PEAK-LIMITED SIGNALS AS TEST SIGNALS 


One application of the above class of peak-limited signals is for use 
as test signals for systems of limited dynamic range. By spreading the 
signal energy among many samples, a test signal of greater total energy 
than an impulse can be used without exceeding the dynamic range of 
the system. This then enhances the signal-to-noise ratio (s/n) of the 
measurement. 

For a system that has approximately a linear-phase response, s/n 
improvements of the orders shown in Table II can be expected. If the 
system has considerable phase distortion, the amount of s/n enhance- 
ment may be less. In an extreme case, a system could act as a “matched 
filter’? to a particular test signal and compress all the signal energy 
back into a single sample. In this case, no s/n improvement would be 
possible with that test signal, although other peak-limited test signals 
in this class might be useful. 

To investigate the use of the peak-limited signals as test signals, we 
chose a system that consists of a complex modulator, a decimator, an 
interpolator, and another complex modulator. The system was im- 
plemented on a 16-bit computer, and the decimator and interpolator 
were designed as discussed in Refs. 2 and 3. The net function of the 
above system is that of a bandpass filtering operation. It represents a 
useful type of system for speech-processing applications (e.g., 
vocoders). 

The frequency response of the system is shown in Fig. 4a. It was 
measured by exciting the system with the peak-limited signal for 
N =7 and taking the Fourier transform of the output. The largest 
peak amplitude signal which could be used without overflow was 
16384, or 2'*. Similarly, the largest impulse that could be used as a test 
signal was 2'4. The frequency response measurement in this case was 
essentially equivalent to that using the peak-limited signal (see Fig. 
4a). The reason for this is apparent. The 16-bit system has a large 
dynamic range (about 90 dB) compared to the frequency response of 
the filter (about 45 dB). Obviously, the use of peak-limited signals is 
not warranted. 

We next considered a 12-bit implementation of the same system.* 
This would very likely be the available word length of a practical 
hardware implementation or small minicomputer implementation. In 
this case, the dynamic range of the system is about 66 dB, and we can 
expect that roundoff noise will affect the frequency response measure- 
ment. The largest magnitude impulse that could be used to test this 


_* This was simulated on the 16-bit system by not allowing the use of the four most 
significant bits. 
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ig, 4—F ency response measurement using (a) an N = 7 all-pass test signal in a 16-bit system, (b) an impulse test signal in an 
ey 12-bit eae. and (c) an N = 7 all-pass test signal in the 12-bit system. 


system without overflow was 1024, or 2. A measurement of the fre- 
quency response based on this impulse response is shown in Fig. 4b. It 
is apparent that the roundoff noise has degraded the measurement con- 
siderably. The passband response has been distorted, and the peak 
stopband signal rejection measures only 31 dB compared to 41 dB in 
Fig. 4a. | 

Figure 4c shows the frequency response measurement of the same 
12-bit system based on the peak-limited signal for N = 7. The maxi- 
mum amplitude that could be used for this signal was 2% and, as can 
be seen from Table II, it contains 10.75 dB more signal energy than 
an impulse of the same amplitude. In comparing Figs. 4a, b, and ec, it 
is clear that the use of the peak-limited signal has improved the 
frequency response measurement of the 12-bit system. The measure- 
ment of the stopband rejection is on the order of 40 dB, or 9 dB better 
than in Fig. 4b. The passband response looks more like the essentially 
noiseless measurement in Fig. 4a. 


V. CONCLUSIONS 


It has been shown that a class of peak-limited and essentially finite 
duration signals can be generated by optimizing the p = © norm of 
the impulse responses of the class of all-pass networks. Signals were 
generated for all-pass filter orders from N = 1 to N = 8. It was 
demonstrated that this class of signals is useful as test signals for 
systems of limited dynamic range. Improvements of up to 11 dB in 
s/n enhancement were found to be possible. 
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A two-dimensional receiver structure has been proposed, incorporating 
two innovations: passband equalization, which mitigates intersymbol 
interference, and data-directed carrier recovery and demodulation following 
equalization, which enables compensation of carrier frequency offset and 
phase jitter, but does not require transmission of a separate pilot tone with 
the data signal. The receiver ts fully adaptive; the adjustment of the equal- 
wer tap coefficients and of the estimate of the current channel phase shift ts 
based on a gradient algorithm for jointly minimizing the mean squared 
error with respect to those parameters. 

In this paper, we analyze the dynamic behavior of the deterministic 
gradient algorithm (where channel parameters entering into the gradient 
expression are assumed known in advance). The corresponding estimated 
gradient algorithm (where these parameters are initially unknown) has 
previously been studied experimentally, but 1s not treated here. 

The first part of the present study concerns system start-up (or transient) 
response when the channel’s phase shift 1s fixed. Examination of the analyt- 
ical solution leads to the qualitatiwe conclusion that, if the equalizer tap 
adaptation coefficient B is small relative to the phase-tracking coefficient a, 
the added phase estimation feature does not strongly affect the start-up 
behavior of the passband equalizer under typical operating conditions. 
Indeed, if the equalizer tap coefficients all start at zero, their evolution in 
the deterministic gradient algorithin 1s completely unaffected by the phase- 
tracking loop. 

The second situation analyzed ts the steady-state response of the system 
to a constant carrier frequency offset. In this case, the phase-tracking loop 
1s found to reduce the resulting rate of rotation of the equalizer taps to about 
B/(a + B) of the original frequency offset. As a result, the degradation in 
system mean squared error due to frequency offset 1s typically quite small. 

The final analysis 1s of the response of a linearized version of the 
receiver structure to sinusoidal phase jitter. When the channel’s linear 
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distortion is not too severe and the coefficient B 1s small, the system mean 
squared error owing to phase tracking error 1s found to approximate that 
of a simple, first-order, phase-locked loop. 


I. INTRODUCTION 


The combination of adaptive equalization and decision-directed 
estimation of a fixed carrier phase offset in suppressed-carrier PAM 
modems by means of a gradient algorithm has been suggested by 
Chang! and by Kobayashi,? the latter also including adaptive timing 
recovery. The receivers contemplated in those papers demodulated the 
received data signal prior to equalization and carrier phase estimation. 

Reference 3 describes an alternative receiver configuration for two- 
dimensional modulated data transmission systems, combining equaliza- 
tion and carrier recovery. This receiver’s distinction is that 1t employs 
a passband equalizer whose reference signal consists of receiver 
decisions amplitude-modulating a carrier whose phase shift is the 
recelver’s estimate of the channel phase shift. Following the passband 
equalizer is a demodulator which compensates for the channel’s phase 
shift (which may be time-varying as a result of frequency offset or 
phase jitter). 

The receiver’s estimation of the carrier phase shift is based on a 
decision-directed gradient algorithm for estimating a fixed phase shift, 
as proposed in Refs. 1, 2, 5, and 6. An advantage of the demodulator 
following the equalizer is that the demodulator’s phase reference is 
delayed relative to the actual channel phase shift by only one symbol 
interval instead of by the entire equalizer delay as in the traditional 
“baseband” receiver configuration. This fact, plus the provision of a 
sufficiently large gain coefficient in the phase-tracking gradient algo- 
rithm, makes possible tracking and compensation of typical conditions 
of frequency offset and phase jitter that may occur on voiceband 
telephone channels. Computer simulations, reported in Refs. 3 and 7, 
have confirmed this capability. 

In this paper, we study the dynamic behavior of the gradient algo- 
rithm for jointly adjusting the equalizer tap coefficients and the phase 
estimate in each of the following situations: (z) start-up (transient 
response) for a fixed carrier phase shift; (77) steady-state response to a 
frequency offset; (777) steady-state response to sinusoidal phase Jitter. 
Throughout, we consider only the deterministic gradient algorithm; 
that 1s, recelver decisions are assumed perfect, and the gradient of the 
mean squared error as a function of equalizer tap coefficients and carrier 
reference is assumed known. A stochastic gradient algorithm, which 
would be used in practice, has been simulated,*” but is not treated in 
this paper. 
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ll. SYSTEM EQUATIONS 


The transmitted two-dimensional modulated data signal is assumed 
to be of the form 


s(t) = Re {> Anzg(t — nT )e?7Fet} 


where A, is a two-dimensional (complex-valued) data symbol trans- 
mitted in the nth symbol interval, g(t) is a band-limited baseband 
pulse waveform, 7 is the duration of a symbol interval, and f, is the 
carrier frequency. The set of possible discrete complex values that each 
A, can assume constitutes the signal constellation. Quadrature ampli- 
tude modulation (QAM) and digital phase modulation (pm) systems are 
familiar examples of two-dimensional modulation systems. We shall 
assume that successive data symbols are uncorrelated; 1.e., 


(A,An) = 1 forn = m 
= 0) otherwise. 


Figure 1 shows the receiver structure. The received signal, after 
transmission through a noisy, dispersive channel which may introduce 
a slowly time-varying phase shift, is passed through a phase splitter 
to produce parallel in-phase and quadrature components. These parallel 
waveforms can be represented as a single complex waveform that is 
sampled and passed on to a passband transversal equalizer with, say, 
2N + 1 complex-valued tap coefficients. In the nth symbol interval, 
when a decision is to be made on the nth data symbol, the latest 
(2N + 1) complex-valued samples stored in the (2N + 1)-tap pass- 
band equalizer can be represented by the complex (2N + 1)-dimen- 
sional vector R,e%, where @, is the channel phase shift (assumed 
quasi-stationary in the nth symbol interval). A sequence {6,} changing 
at a constant rate with time is an example of frequency offset, while 
{0.} varying randomly or quasi-periodically constitutes phase jitter. 
Typically, the change in @, in one or two symbol intervals is so small 
as to allow us to neglect the phase-to-amplitude modulation con- 
version effected by filtering the sequence of incidental frequency- 
modulated components {e}. 


A 
exp[—j(27f,nt + 6,)] 
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Fig. 1—Two-dimensional receiver. 
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The (2N + 1) complex equalizer tap coefficients in the nth symbol 
interval are denoted by the complex (2N + 1)-dimensional vector 
C, = (c_n, «++, Co, +++, Cn).* The symbol * will denote transposed 
complex conjugate throughout. Then the nth complex equalizer output 
is 

Qn = C,R,e*, (1) 
the real part being interpreted as the in-phase component and the 
imaginary part as the quadrature component. 

The receiver’s estimate of @, is a real quantity denoted by 6,, and 
the demodulator output is written 


Vu = QnewserfenT+4n) (2) 


This quantity is passed into a simple quantizer to produce A», which 
is the receiver’s decision on An. Based on this decision, the complex 
reference signal used for updating the equalizer taps and the phase 


estimate 1s 
On = Aes ersenT+8n), (3) 


We define the properties of the channel in terms of expectations 
(denoted by (_ )) with respect to the ensembles of information symbol 
sequences and additive noise samples. The complex impulse response 
X is defined by 

1 


(ape - 


The positive definite Hermitian @ matrix of the channel is defined by 
1 
~ ((Aa[ 
The normalized mean squared error in the nth symbol interval is 
defined to be 


(R.R;). (5) 


én = = TA 12) (| Qne7 i@nfent tin) — A, |*); (6a) 
which, by virtue of (1), (4), and (5), can be rewritten as 
= 1—X*@7X + yn, (6b) 


where yn = E,GE, = 0 is the excess mean squared error and E, is a 


tap-error vector, . 
E,, = C,,e76n-) — Q-1X, (7) 


Since @ is positive definite, the value of e, is a positive minimum,’ 
1 — X*@-X, when the equalizer taps C, and phase shift estimate 6, 


' The positive quantity X* @—'X is therefore less than unity, a fact which is exploited 
in the appendix. 
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are adjusted so that E, = 0, or 
Cnc = Q- Xen, (8) 


This equation is also the condition for the gradients of e, with respect 
to C, and 6, to be jointly zero; it is satisfied by an infinitude of points 
(Cr, 6n). 

Thus, a gradient algorithm can be used to adjust the tap coefficients 
C, and phase estimate 6, recursively toward optimal values. The 
equations governing the evolution of {C,} and {6,} are? 


Casr = (I — BQ)C, + BXe-1Gnn (9) 
and 
Baga = On + a@ Im [ORK e-3On on) 7, (10) 


where J is the identity matrix and 8 and a are positive gain coefficients. 
These equations [ or the equivalent equations (13) and (14) ] form the 
basis for the results in this paper. 

In practice, X and @ would generally not be known in advance, and 
the following stochastic gradient algorithm,’ involving the equalizer in- 
puts R,e*», outputs Q,, and modulated decisions O,, would replace 
the deterministic gradient algorithm described by eqs. (9) and (10). 


Cay1 = Cr — BRpe*%(Q* — OF). (11) 
ees eee AE Im (Q,0%). (12) 


These are coupled stochastic difference equations, since successive 
vectors {R,} are correlated random variables. Simple stochastic 
gradient algorithms have been studied by Widrow.® The application 
to equalizer adaptation, where no phase recovery is involved and under 
the assumption that the {R,} are uncorrelated, has been studied by 
Ungerboeck,® by Gersho,!’ and by Gitlin, Mazo, and Taylor.!! The 
extension to correlated vectors {R,} has been introduced by Daniell.” 

That the algorithm specified by (11) and (12) converges and can 
perform satisfactorily 1s confirmed by the computer simulations re- 
ported in Refs. 3 and 7. Analysis of the stochastic gradient algorithm 1s 
complicated by the possibility of a cycle-slipping phenomenon as in 
phase-lock loop systems. References 5 and 6 deal with continuous- 
time, decision-directed, phase-locked loops in the absence of adaptive 
equalization. 

However, insight can be gained by studying instead the deterministic 
gradient algorithm of (9) and (10), since the estimated gradient algo- 
rithm can be interpreted as implicitly performing the averaging in- 
volved in determining X and @, provided the signal-to-noise ratio is 
high and the gain coefficients a and @ are sufficiently small. 
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Using definition (7), we can rewrite the coupled difference equations 
as 


Ena: = (I — BQ)E,e%4nti-dnty 4 Q@-IX(eiAnti—Ant) — 1) (18) 


and 
Anyi = alm (E;X), (14) 


where 
An+1 = On41 res On and Anti = On+1 Ons 


Ili. SYSTEM START-UP WITH FIXED CHANNEL PHASE SHIFT 


In this section, we study the behavior of the deterministic gradient 
algorithm during start-up, assuming the channel’s phase shift 1s fixed: 
6, = 0.1 General theorems tell us that, if the initial error and the 
coefficient of the gradient algorithm are small enough, convergence is 
guaranteed.!? However, we are interested in sharper results for the 
specific problem at hand. 

The solution of (18) and (14) will depend on the initial choice of 
E (or Co) and 6. It is interesting to consider first the special case 
C, = 0, the all-zero vector; i.e.. Eo = — @~X. In this case, 


Ai = —aIm [X*@7X] = 0, 
since @ is Hermitian, and 
E, = —(U — 6@)@'X. 
Continuing, it is easy to show that 


A, = 0 for all n 


and that 
E, = —(U — 8@)"@7X. (15) 


Thus, at least for this special all-zero starting condition, the estimated 
carrier phase shift 6, does not change at all and the start-up behavior 
of the deterministic algorithm is exactly the same as that of the pass- 
band equalizer alone. 

Let us now consider the more general case, when Ep is not necessarily 
equal to the right-hand side of (15) for some n 2 0. We remark that 
the mathematical formulation of this start-up situation will be basi- 
cally the same as that of a system transient caused by an abrupt change 
in the channel’s carrier phase shift. 

Expression (6b) for the normalized mean squared error involves the 
positive definite quadratic form E;@E, = yn. We can bound this term 


t There is no loss of generality in assuming a fixed phase shift of zero, since any 
nonzero fixed phase-shift factor e/® can be incorporated in the complex channel im- 
pulse response X. 
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and study its evolution by writing down a recursive expression for it 
and upper-bounding the right-hand side of that expression. Using (13) 
with A,1 = O for all n, we can write 


You = En, — B@)@U — BQ@)E, + X* @-1X] e/Ants —1|? 
+ 2Re {E,W — 6@)X(1 — e~JAnt1) } (16) 


The right-hand side of expression (16) is upper-bounded in the ap- 
pendix. The derivation of the bound requires the following assumptions 
about the channel and algorithm parameters. 


Assumption (1): The initial value yo = Eo @Eo is less than unity. This 
condition is fulfilled, for example, if Co = 0; 1e., EX = — @-'X, for 
then yo = X*@7X S 1, since the positive quadratic form X*@7'X, 
which is one minus the minimum mean squared error,.must be less 
than unity. 

Assumption (2): a < ao, where ao is the solution of 


ao(1 + V0) = 2 sine (aoVyo), 
where 


sinc @ = sin 8 
g 


Assumption (3): Let the maximum and minimum eigenvalues of the 
positive definite Hermitian matrix @* be denoted respectively by \max 
and Amin. Then the gain coefficient 6 must satisfy 

2Mmin 
Maal €5) 


where ¢ is defined in terms of a by 


0<B< 


a (1+ Vio + 3) = 2sine (ov), a < a. 


Figure 2 illustrates the solution of the equations defining ¢«§ and ao. 
For example, if we assume a = 0.5 and yo = 1, then ap is 0.88 and 
e is 0.543. 

The upper bound obtained in the appendix is 


Yn41 = En 1QEn41 S E, GE, i 26E;,G@?E, 
+ @(1+ @)E,Q@E,. (17a) 


An explicit bound on yn, is obtained by first weakening (17a) using 
(41) of the appendix to obtain 


Yap1 = (1 — 2BrAmin + B2(1 + 6G) Max) Ya) (17b) 
so that 


lA 


Yat1 = (1 — 28min + cme = €3) Max)” 0- (17¢) 
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Fig. 2—Illustration of the definitions of & and ap. 


In the absence of phase tracking, a = A, = 0, and the mean 
squared error at step n + 1 of the deterministic gradient algorithm is 
obtained directly from expression (15)*?14 as 


Ynu1 = LD d(1 — Bd)?" | Soe /’, (18) 


where the summation is over all the eigenvalues of the matrix @, the 
{A;} are the set of eigenvalues, and &; is the inner product of Eo with 
the normalized 7th eigenvector. 

Comparison of the upper bound (17c) for the joint equalizing and 
phase-tracking receiver and the exact expression (18) for the equalizer 
alone yields some insight into the penalty in convergence rate imposed 
by the additional phase-tracking algorithm. Consider an example where 
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all {\;} (and therefore Amax and Amin) are equal to a common value ». 
This would represent the case of a channel with delay distortion but 
not amplitude distortion (flat Nyquist equivalent frequency charac- 
teristic). Then inequality (17c) becomes 


Ynt1 S LCL — BA)? + BMG }vo, (19) 


and, recognizing that 
Y= 2 di | Go: |?, 


we can write equality (18) for the case of no-phase tracking as 
nti = (1 — Bd)?"yo. (20) 


In practice, the equalizer adaptation coefficient 8 is small (8 « 1/)), 
to minimize the mean squared error resulting from a practical stochastic 
gradient algorithm.’ Thus the right-hand sides of (19) and (20) should 
be nearly equal, and we conclude that an ideal gradient algorithm for 
joint phase tracking and equalization should not converge appreciably 
slower than the equalizer adjustment algorithm alone. An exact 
analytical evaluation of the effect of phase tracking on the convergence 
of a practical stochastic gradient algorithm for a severely distorted 
(Xmax >> Amin) Channel remains elusive. However, the results of this 
section suggest that the influence of the phase-tracking parameter a 
in the convergence is relatively small. This conjecture is bolstered by 
the experimental results summarized in Figs. 3a and 3b. A 9600-b/s 
two-dimensional data transmission system was simulated, employing 
the stochastic gradient algorithm described by eqs. (11) and (12). 
The transmission channel, whose frequency characteristics are shown 
in Fig. 3a, was regarded as severely distorted (it violates the minimum 
standard for private line voiceband channel data transmission). The 
plots of measured mean squared error versus time for a = 0 and for 
a = 0.2 shown in Fig. 3b are very similar, indicating that little penalty 
in convergence rate is to be ascribed to the use of joint decision- 
directed phase tracking. 


IV. CASE OF FREQUENCY OFFSET 


In this section, we study the behavior of the system in the presence 
of frequency offset by obtaining steady-state solutions to eqs. (13) and 
(14) when the channel phase shift increases linearly with time; Le., 
A, = 2rAT, where A is the frequency offset. In this case, eq. (13) 
becomes 


Engi = (I — BQ)EneiAnti2raT) 4. Q-1X (eiGnti-2747) — 1), (21) 
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Fig. 3a—Frequency characteristics of the simulated channel. 


A steady-state solution to (21) and (14) is obtained by substituting 
the trial solution, 
E,=E 
An = 2r(A + 5)T, 


l 


and then solving for the fixed quantities E and 6. The substitution 
results in 
E = (e2T — 1)M—@X, (22) 


where MV is the matrix | 
M =I — e®®T(I — BQ) 


and 
2r(A + 6)T = alm (E*X). 


= a Im [(e-#"? — 1)X*@oM*OX]. (23) 


It is clear from the definition of M that the eigenvectors {u:}“y of @, 
which form a complete orthonormal set, are also those of M. Thus, 
expressing the vector X as a linear combination of u,, we write 


N 
X= 2 Gi, 


i=—N 
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Fig. 3b—Convergence with and without phase tracking (ideal reference; all 
equalizer top coefficients start at zero). 


we can rewrite (23) after a little algebra as 


| x Gi? 
2a + OT = almlem 01,2, AA 


us | Gil? 
ee 2 
aoe ed <a 1—- DE = BN;) cos 27r6T + (1 = Bv;)? : ( 4) 
where {\,}7/—y are the eigenvalues of @ and are positive and real. 
The excess mean squared error is similarly given by 
yn = E,GE, = |e? ? — 1/*X¥*@1M*@M@a Xk 
= 2(1 — cos 27r6T) 
> IGs/? 
i=—N \[1 — 2(1 ma BN) cos 276T + (1 = Br;)*] 
Equation (24) is a transcendental equation whose solution 6 1s 


clearly not zero in general. The quantity 6 may be interpreted as a bias 
in the receiver’s estimate of the frequency offset. This ‘‘residual”’ 


(25) 
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frequency offset then must be compensated for by a rotation of the 
equalizer complex tap coefficients at rate 6 Hz. 

For purposes of illustration, we again consider only a special case 
of a “good” channel, for which all \; = 1 and >-; |G,|? = 1. Then (24) 
becomes 
—afZ sin 2rb6T 


FEU pdm 0) 


2r(A + 6)T = 
Typically, 8 <<a <1; for example, 8 = 0.001 and a = 0.2. The left- 
and right-hand sides of (26) as functions of 2767 are sketched in Fig. 4. 
Apparently in the region of intersection, 2767’.< 8 and sin 276T 
f& 27ST. Solving (26) with this approximation yields 


— 27a 


B 





Q2r(A + 5)THR 6T. 


Thus 


~~) 27 

a+ 6 le 
and the necessary rate of rotation of the equalizer taps has been reduced 
by a factor of B/(a@ + 8), which is about 1/200 for a typical case, 
a = 0.2,8 = 0.001. The corresponding normalized excess mean squared 
error is 





eee B24. (Qe bT)2 ~ (a + B)? + (QrAT')? 


If A= 1 Hz, a= 0.2, B = 0.001, T = 1/2400 s. This amounts to 
about 10-4. 


(28) 


V. STEADY-STATE SINUSOIDAL RESPONSE 


The phase jitter process {@,} that occurs in telephone channels is 
typically quasi-periodic. It is thus of interest to determine the steady- 
state solution of the coupled difference equations (13) and (14) when 
the driving term {6@,} is sinusoidal. 

It 1s convenient at this point to rewrite eqs. (13) and (14) further 
in terms of eigenvalues and eigenvectors of the matrix @. Since @ is 
Hermitian, its eigenvalues {\;}/.-y are positive real and its eigen- 
vectors {u:}/._» form an orthonormal set which is a basis in 2N + 1- 
dimensional space. Using these properties and expressing the vectors 
E, and X as linear combinations of the {u,}, 


N 

En = > Eniti 
1=—N 
N 

X= De Giwi, 
1=—N 
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62 + 2(1—)(1— cos x) 


~~ 27AT +x 


0 x 
/ 
7 


SOLUTION “~ 
x = 276T 


Fig. 4—Illustration of the solution of 


Qr(A + 5)T = —af sin 276T 


6? + 2(1 — B)(1 — cos 2787’) 


we can write (13) and (14) as 


Einaayi = (1 — BA,) Ee Antim~Anti) a (e5(Anti—An41) =f) 
| —~NSisN (29) 


+ 


and 


N .- 
Anyi = a@ DY Im (6,44). (30) 
j=—N 


i= 
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We now make the following change of variable in (29) and (80). 
Define : 
Eni ich On) = ny + Uni. (31) 
Then we can write the real and imaginary parts of (29) as 
|G: |? A , 
¥ [cos (@n — On) — cos (Bn41 — On41) |, 
-NSi8EN_ (82) 


Ucng1yi = (1 — Bra + 





and 
VG |e. Ge a 
Vingiys = (1 — Bra)oni + ee [sin (6n — On) — sin (On41 — On41) | 
—-NsSiSN, (83) 


and we can write (30) in the form 


N 
Bait — On = @ om [oni cos (On — On) — Unisin (6, — 6,)]. (34) 

Equations (32), (33), and (84) are a set of nonlinear coupled differ- 
ence equations. In particular, eq. (84) is reminiscent of the equation 
governing a discrete-time, first-order, phase-locked loop. We shall solve 
linearized versions of (82), (33), and (84). Assuming the steady-state 
error angle (6, — 6x) for n > 1 is very small, we replace cos (6n —@n) 
by 1 and sin (8, — 02) by (@n — On). Then (32) becomes 


U(n+1)i = (1 = Brz)Unt, 
= (1 — Br)"* oi, —-Nsi8sN, 
which approaches zero in the steady state (assuming 6 < 1/X; for all 2). 


Thus in the steady state we are left with the linearized versions of (33) 
and (34): 


G; 2 A A 
V(n41)i = (1 = Bri)0ni + Gl" (On41 — On = On44 + On) 
—-NSi1SN _ (85) 
and 
m 2 N 
6n41— On =a dX Uni (36) 


1=—N 


Equations (35) and (36) are linear and can be solved for a given 
sequence of channel phase shifts {@,}. We consider the case where the 
phase jitter is sinusoidal with frequency w rad/s; 1.e., 


6, = Re (Je), 
where J is a complex constant. The solution for {v,:} is also sinusoidal: 


Uni = Re (Vie”"7). —-NSitSN. (37) 
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Substitution of this trial solution in (85) and (36) yields a value of 
VY; after some algebraic manipulations. 
Jl 682) Gi" 
V; = ges 8s Saye a ae pee ee Be ee eS ee ee ed 
Ai(1 — BA; — e#7) (1 =a Do (Gel 7/ 0 = Bh = e#7) J) 
k=—N 
(38) 
It follows from the sinusoidal variation of {vn:}.-» that the error 
angle {8, — 6n} and the equalizer tap coefficient vector C, also vary 
sinusoidally with frequency w in the steady state. 


The excess time-averaged mean squared error can be calculated from 
expression (31), (87), and (88). 


Y = (yn) = (E,GE,) 


N 
= Do Ait] Ens|?) 
1=—N 
_ lJ [P{1 — e?/78i 
< 2/1 — e#T — a§,|?’ (39) 
where 
_ Gi? 
Si= 2 yi o/ = i 
and 
_< |G]? 
Ses 2 y Xl — B/C — 7) 
The total mean squared error is, from (6b), 
(en) = 1— X¥*Q7°KX + y 
N ,|2 2 — pjwT|2 
_ | G:| 4 [J [PEL = et 281 (40) 


Ly yt Bll oF — oS? 
Typically, if the overall mean squared error is close to zero, 
N [2 
IGP oy and BA: K [1 — eT]. 
Then the excess mean squared error in (40) is approximately 


| J |? | 4 an eset | 2 
2/1 — e#T — @|? 


This expression corresponds to a previously derived, approximate, mean 
squared error due to sinusoidal jitter in the absence of noise [see eq. 
(39) of Ref. 3 ]. That equation, valid for a first-order, phase-locked loop, 
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was derived ignoring the coupling between eqs. (13) and (14) and 
assuming perfect equalization. Calculated curves of mean squared 
error versus a are found in Ref. 3. 


Vi. CONCLUSIONS 


Previous studies have shown that the functions of joint passband 
equalization and data-directed carrier recovery in a QAM receiver can 
be formulated as a gradient search algorithm. If the channel parameters 
entering into the expression for the gradient of the mean squared error 
are known, it 1s termed a deterministic gradient algorithm. In this 
paper we have analyzed the start-up behavior of the deterministic 
gradient algorithm and also the steady-state response to frequency 
offset and to sinusoidal phase jitter. The more practically motivated 
stochastic or estimated gradient algorithm, in which the channel 
parameters are initially unknown, has been studied experimentally and 
awaits further analytical study. 

It was shown that, under typical channel conditions, when the 
carrier phase offset is fixed, phase tracking does not greatly slow down 
the start-up behavior of the deterministic gradient algorithm, at least 
provided the equalizer adaptation coefficient 8 is much less than that 
of the phase estimator a. 

The phase estimator was first proposed as an adjunct to the pass- 
band equalizer, to mitigate the effects of too-rapid tap-coefficient 
rotation in the presence of channel frequency offset. It has been shown 
that frequency offset still causes tap rotation in the equalizer-plus- 
phase estimator system, but that the rate of rotation is tolerable, being 
on the order of 1/[1 + (a/8)] times the amount of frequency offset. 

The steady-state response of the linearized system to sinusoidal phase 
jitter was obtained. When linear distortion in the channel is not severe 
and the coefficient 8 is small, the system mean squared error due to 
tracking error approximates that of a first-order, phase-locked loop, 
as Was assumed in an earlier paper. 


APPENDIX 


We wish to upper-bound the right-hand side of (16), given assump- 
tions (1), (2), and (8) of Section ITI. 


EX. i@Enu1 = EX — 6@)@(I — B@)E, + X*@—7X| een — 1/2 
+ 2 Re {Ex(I — B@)X(1 — e->)}, (16) 


where A,.1 was given by (14). 
The first term on the right-hand side can be written 


EGE, — 26E,G@’E, + BE, @En. 
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The matrix @ is positive definite and Hermitian; hence, 
—E,@’?E, = —(@'E,)*@(@iE,) S —\minE,@En, 


where Amin is the minimum eigenvalue of @. Similarly, E;,@’E, 
< \24,E;,@E,, where \max is the maximum eigenvalue. Thus we note 
for future reference that the first term in (16) 1s bounded as 


EX(I ~— B@)@(I — BG)E, S (1 — 26Amin + B’Amax)En@En. (41) 


The second term in (16) is 


~ 


A Seay Aes 
X* @—7X| e441 — 1[? S sin? a : 


since X*@—X < 1. Upper-bounding sin? (An4:/2) by (Ani1/2)? and 
substituting expression (14) for Ani1, we have 


X*@—X | e441 — 1/2 < a*{[Im (EzX) P. (42) 


The third term in (16) can be written as the sum of three terms. 
2 Re {E*(I — B@)X(1 — e-“n)} = 4 Re [E*(I — 8@)X] sin? xt 


As in the inequality (42), the first term in (43) is upper-bounded by 
| E,(Z — 6@)X|[Im (E,X) P. 


The matrix J — 6@ is Hermitian; its eigenvalues are {1 — 6d,}, where 
the {\;} are the eigenvalues of @. Let \max and Amin be the maximum 
and minimum eigenvalues, respectively. By assumption (3), 1 — B\max 
> 0 and thus J — 8@ is positive definite. Therefore, 


|E,(I — 6@)X| = |E,U — 6@)'ai@ i — 6a@)x| 
< [E,a' — @@)@E, }}[X*aiVT — 6a) @ix}, (44) 
where we have used Schwartz’s inequality. Using the positive definite- 


ness of J — 8@ and @, we can further upper-bound the right-hand 
side of (44) by 

< (EX@E,)}, (45) 
since the quantities 1 — 6\min and X*@~'X are less than unity. Thus 
we have upper-bounded the first term in (43) by 


~ 


4 Re {E*(I — 6@)X} sin? Ax < o?(E*GE,)i[Im (E*X)}. (46) 
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After substituting for A,,, using eq. (14), we can express the second 
term in (43) as 


—2 Im (E;X) sin Ani, = —2a[Im (E;X)]? sine [a Im (E;X)], (47) 
where 
sin 9 


sinc 6 = ar 


The third term in (48) is 
28 Im (E,@X) sin Ans, 


which can be upper-bounded, using (14) and the inequality |sin A| 
< |A|, by 


208 (|E,@X|)[|Im (E,X)|] S 6?|E,@X|? 
+ S [Im (E;X) }? for any arbitrary e, 
where we have used the simple inequality 
2aBAB < oped? + % Be 


But 


|E,@X|? = | (E,@)(@-X) |? 
(E, @3E,,) [X* @7X] 
< E,@°E,, 
by Schwartz’s inequality and the fact that X*@—X S 1. 
Thus the third term in (48) is upper-bounded by 


IA 


2 
26?(E*@E,,) + 3 [Im (E*X) }. (48) 
Finally, substituting (42), (46), (47), and (48) into the right-hand 
side of (16), we have 


You = Eqsi@Eni S ELGE, — 26E,@E, + @(1+ &)E,@E, 
+ a®R»lIm (E7X)}, (49) 


where ¢ ls arbitrary and 
n = a E + (E,GE,)? + al — 2sine [a Im (E;X)]. (50) 


We make the following choice of €: € = €9, where €o is defined by (with 
vo = E> QE») 


a (1 + yo + 4) = 2sine (avy). (51) 
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Figure 2 is a sketch of the left- and right-hand sides of eq. (51) as func- 
tions of a for various values of e9. Equation (51) has a unique solution 
with 0 < & < © as long asO S @ < ap, where ap is defined by 


ao(1 + V0) = 2 sine (aoV yo). 


Note also that, by assumption (3), the coefficient 1 — 26min 
+ B\max of E;,@E, in the bound (41) is less than 1 and hence (49) 
can be weakened to 


E*,,@E,.1 S EX@E, + &,[Im (E*X)}. (52) 


Lemma: @n is negative, and hence the sequence {yn = E,QEn} is mono- 
tone decreasing. 

Proof: We first observe that the sinc function in (50) defining ®, is 
even, positive, and monotone decreasing provided its argument’s 
absolute value is less than +. But its argument is 


a Im (E;X) S a|E,@? aX]. 
This can be bounded, using Schwartz’s inequality, by 
a(E, @E,X*@7X)? < a(E,@E,)? 


and so 
— sinc [a Im (E;,X)] S —sinc [a(E,@E,) ] for a(E,G@E,)? < zx. 
(53) 
In particular, 
a Im (E*X) < avy <3 

by assumption (1), and hence we can upper-bound ®o by 

& Sa(1t+ Vie +5] — 2sine (aV yo). (54) 

0 


According to our choice of ¢€ = ¢€o, defined by (51), the right-hand 
side of (54) is zero, and so ®y S 0. It follows from (52) that Vy1 < Vyo, 


which is less than z by hypothesis. Thus ®; is bounded, using (53) and 
€ = €, by ®1 S 1, where &, is defined by 


hy = aft t+ at % | - 2sine (ard), (55) 
0 
and ®o = 0 by the definition of e2. Now since Vyi < Vyo S 7, 


—2 sine (ay}) < —2 sinc (ay) 


and so 
R,< Rk SR =0. 
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Similarly, from (52), ye < y1 and by induction 


Vo SV nA S-:-S ¥o 


and all ®, S 0. 
Q.E.D. 


Finally, since ®, is negative, we obtain the following recursive upper 
bound from (49): 


You = En4i:@Eny: S E,GE, — 26E,@E, + 6(1 + @)E,G@*E,. (56) 
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The spectral or band occupancy of an RF signal ts often defined as the 
bandwidth that contains a specified fraction (usually 99 percent) of the 
modulated RF power. The band occupancy of binary and quaternary PSK 
szgnals with and without RF filtering and with modulation pulses of several 
shapes has been evaluated and the results presented in graphical and 
tabular form. For a binary FSK signal with phase deviation of +1/2, 
sometimes called an FM-PSK signal, numerical values of the spectral oc- 
cupancy with rectangular and ratsed-cosine signaling have been obtained 
and the results given in graphical form. For a binary PSK signal with 
signaling rate 1/T and with arbitrary baseband pulse shaping, we have 
derived a lower bound on the fraction of the continuous power contained 
outside any given band, but have not been able to get a bound on the total 
band occupancy. However, for an FM-PSK signal, a lower bound on the total 
band occupancy has been derived, and it 1s shown that the value of this 
lower bound for 99-percent power occupancy ts 1.117/T. The 99-percent 
power occupancy bandwidth of an FM-PSK signal is 1.170/T with rectangu- 
lar signaling and 2.20/T with raised-cosine signaling. 


l. INTRODUCTION AND SUMMARY 


Efficiency of use of the radio spectrum has recently become the 
subject of increased attention since terrestrial and satellite com- 
munication needs have placed an increasing burden on the available 
RF bands.!? For spectrum conservation, the band occupancy of the 
chosen modulation scheme must be small so that as many channels as 
possible can be accommodated in a given band. Since the band oc- 
cupancy of analog signals has been extensively discussed in the litera- 
ture,*~° we shall deal here only with digital signals. 

For radio systems, the “‘occupied bandwidth” is often specified by 
the spectral band which contains a certain fraction of the total RF 
power.* The Federal Communications Commission (FCC) presently 


“For analog rM systems, an alternate way of specifying bandwidth is discussed in 
Ref. 5 
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specifies this power to be 99 percent and requires that not more than 1 
percent of the power be contained outside the assigned band.® For 
radio transmission using digital modulation techniques, the additional 
requirements presently specified by the FCC are in terms of the spectral 
density of out-of-band emission rather than just total out-of-band 
power.* For operating frequencies below (above) 15 GHz, the attenua- 
tion A, expressed in dB and equal to the mean output power divided 
by the power measured in any 4-kHz (1-MHz) band, the center fre- 
quency of which differs from the assigned frequency by 50 percent or 
more of the authorized bandwidth, shall not be less than 50 dB (11 dB) 
and shall satisfy the relation A = 35 + 0.8 (P — 50) + 10 logio B for 
operating frequencies below 15 GHz and the relation A 2 11 + 0.4 
(P — 50) + 10 logiy B for operating frequencies above 15 GHz where 
P is the percent difference from the carrier frequency and B is the 
authorized bandwidth in megahertz. For operating frequencies below 
(above) 15 GHz, attenuation greater than 80 dB (56 dB) is not re- 
quired for any value of P. While this is the ‘“‘necessary bandwidth” 
specified by the FCC, the quantity “occupied bandwidth” still remains 
as one of the parameters used to specify the assigned band.t 

The spectral occupancy of binary and quaternary Psk signals with 
nonoverlapping pulses of several shapes has been determined and the 
results presented in graphical form. The 99-percent power occupancy 
band of a Psk signal with rectangular signaling is extremely large; 
hence, for this case we also give the band occupancy when different RF 
filters are used to confine the spectrum. 

By using the classical work of Slepian, Landau, and Pollak,*:® we 
derive a lower bound on the fractional power, contained outside any 
given band, of the continuous part of the binary psk spectrum.” It is 
shown that the lower bound can be achieved if the baseband pulse is 
the inverse sine function of a certain prolate spheroidal wave function. 
It is also shown that the smaller the value of the lower bound, the 
smaller the amount of total power that can be contained in the con- 
tinuous part (the total RF power has been normalized to unity). We 
have not been able to get a bound on the total fractional power that 
may be contained outside the assigned band of a binary PSK signal or 
find an optimum pulse shape if the total power contained in the con- 
tinuous part is assumed to be a specified fraction of the total rF power. 

For a binary Psk signal with phase deviation of +7/2, sometimes 
called an FM-PSK signal, numerical values of the spectral occupancy 


“For details, see FCC Docket 19311, FCC 71-940, adopted September 8, 1971, 
released September 15, 1971; FCC 73-445, adopted May 3, 1973, released May 8, 
1973; FCC 74-985, adopted September 19, 1974, released September 27, 1974. 

* Another method of determining ‘sufficient bandwidth” for psk systems is dis- 
cussed in Ref. 7. 
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with rectangular and raised-cosine signaling have been obtained and 
the results are given in graphical form. For such a binary Fsk signal 
with arbitrary baseband pulse shaping, a lower bound on the total band 
occupancy has been derived, and it is shown that the value of this 
lower bound for 99-percent power occupancy is 1.117/7', where T is 
the signal interval. The 99-percent power occupancy bandwidth of an 
FM-PSK signal is 1.170/7' with rectangular signaling and 2.20/T with 
raised-cosine signaling. The good spectral properties of an FM-PSK 
signal with rectangular signaling are well known," and it may be de- 
tected as a PSK signal with the same bit error rate performance as that 
of BPSK.” 


ll. SPECTRAL OCCUPANCY OF DIGITAL SIGNALS 


In our analysis for psk and FM-PSK systems, we assume that the 
baseband signaling pulses have a common shape and that all signaling 
pulses are equally likely. We also assume that symbols transmitted 
during different time slots are statistically independent and identically 
distributed. 

If the digital angle-modulated (Psk or FsK) wave is represented as 


x(t) = Re exp {j[2rfit + &(t) + OJ}, (1) 


it is shown in Refs. 10 and 13 that the power spectral density P,(f) 
of x(t) can be expressed as 


where P,(f) is the power spectral density of 
v(t) = eFC) (3) 


and jf, 1s the carrier frequency. In (1), 8 is assumed to be a random 
variable uniformly distributed over [0, 27). 

The fractional power A? contained outside the band [f.-W, f.+W |] 
can be shown to be 


a= 2 ["Ppaf— [Papas (4) 


In most cases of practical interest, P,(f) is a rapidly decreasing func- 
tion of f, f./W > 1, and* 


A? = 2 | P,(f)df. (5) 
W 
“Since P,(f) = 0, a? $2 [ P,(f)df for any f./W. 
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2.1 Spectral density of an M-ary PSK signal 


For an M-ary psk signal (we assume M = 2%, N an integer) with 
signaling rate 1/T, 


5 (1) = 


[ew 


where a; is a vector-valued stationary random process and g(t) | are 
the pulse shapes corresponding to the M symbols. 

If the signaling pulses in different time slots never overlap, it is 
shown in Ref. 10 that P,(f) consists of a line component part P,,(f) 
and a continuous part P,.(f), P.(f) = P., + P..(/f), 

Zs n 
Pal) = pale RI SS 8(t- Fz), (7) 
1 MM mM 
P,.(f) = aT xu x wi; (Rif) — Bs(f)|*, (8) 
where Ww = [W, Wo, +--+, Wx], Weis the probability that the 7th signaling 
waveform g;(t) is transmitted in any time slot and R;(f) is the Fourier 
transform of 7;(¢), 


ay — exp L7gi(t) J, 0<i<T ; 
pi | 0 ; otherwise. (9) 


Since we assume that the M signaling pulses have a common shape, 
&(t) = Lat, a2, +++, aarig(d), (10) 


where a; is the peak phase value of the 7th symbol and the maximum 
value of g(t) has been normalized to unity. 
From (5), 
A? = AP + AY, (11) 
where 
A? = 2 / P,,(u)du = the fractional part of line power (12) 
ig contained outside the band 


and 


A’ 


2 [Pi (u)du 


the fractional part of continuous (13) 
power contained outside the band. 


2.2 Spectral density of an M-ary FSK signal 


For an M-ary rsx signal, 


2) = | falu)du, (14) 
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fat) = SX ayht—kT)], bh), =0,t50,t> 7, (15) 


Pi(f) = FRA (A+ At)-RM AI (16) 
where 
1 ers Ty | ‘rd: Wa 
A= 5 Wa 1 — e®T wer (T) |’ Iw-r(T)]| <1, (17) 
Wy 0 
We 
Wa = (18) 
0 Wu 


R;(f) is the Fourier transform of r;(¢), and 


t 
; < 
BOS exp E [ hala ; 0<tsT (19) 
0 : otherwise. 


We make the same assumptions for rsk as for psK. However, note 
that P,(f) does not contain any lines if w] and r(é)] satisfy the in- 
equality in (17). Since spectral lines do not often contain any useful 
information (except for carrier recovery), their presence indicates 
nonoptimum pulse shaping. In this paper, we shall not consider FSK 
with spectral lines. For rsk, A? = A? from (5). 


iit. BAND OCCUPANCY OF A BINARY PSK SIGNAL 


For binary PSK, we assume that a; = —az = 7/2 and that both 
symbols are equally likely. From (8), 


Po.) = ge IRD — BaD (20) 


where 


| 


Ri(f) = R2(f) — i. [ e9(m/2)0 Ce) = eI(ml2)a(t) lesa ftdy 
0 


a ia T ; 
= 27 / sin | 5 v(o| ePrtidt, (21) 
0 


For rectangular, cosinusoidal, raised-cosinusoidal, trapezoidal, and 
triangular g(t), we have calculated P,(f) from (7) and (8) and A? from 
(5). For these cases, the total out-of-band power ratio A? for binary 
PSK is plotted in Figs. 1 and 2. The 99-percent (or any other fractional) 
power bandwidth occupancy for binary psK may be determined from 
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NORMALIZED POWER IN THE TAILS 
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Fig. 1—Normalized power contained outside the band [—W, W] for binary psk 
with different baseband signaling waveforms. 


these figures. Since the 99-percent power occupancy of binary psk with 
rectangular signaling is very large, we show the bandwidth occupancy 
with RF filtering in Figs. 3, 4, and 5. 


lV. BAND OCCUPANCY OF A QPSK SIGNAL 


For apsk modulation and for equally likely symbols, 


P(N) = gap & &, [RAD — RADE (22) 
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Fig. 2—Normalized power contained outside the band [—W, W ] for binary psx 
with different baseband signaling waveforms. 


where f:(f) 1s the Fourier transform of 7r;(t), 


exp[jag@)], O<tST 
0 ; otherwise, 


ri(t) = (23) 


and 
Tv 


Qi = (21 — 5) 4? 
P,,,(f) is given by (7). 

For rectangular, cosinusoidal, raised-cosinusoidal, trapezoidal, and 
triangular g(t), we have calculated P,(f) from (7) and (8) and A? from 
(5). For these cases, the total out-of-band power ratio A? is plotted in 
Figs. 6 and 7. The 99-percent (or any other fractional) power band- 
width occupancy for quaternary PSK may be determined from these 


figures. Since the spectral density of @Psk with rectangular signaling 


l= 1, 2,3, 4. (24) 
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PSK WITH RECTANGULAR SIGNALING 
AND TWO-POLE BUTTERWORTH 
TRANSMISSION FILTER 


NORMALIZED POWER IN THE TAILS 
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Fig. 3—Normalized power contained outside the band [—W, W ] for M-ary psk 
(M = 2%, N 21) with rectangular signaling and a two-pole Butterworth trans- 
mission filter. The squared amplitude characteristic of the equivalent low-pass filter 
is assumed to be given by |Hr(f)|? = 1/[1 + (f/A)*], where 2B = 2A (1/4) /sin 1/4 
is the noise bandwidth of the filter. 


is the same as that of BPsK, the bandwidth occupancy of @Psk with RF 
filtering is also given by Figs. 3, 4, and 5. 


V. BAND OCCUPANCY OF AN FM-PSK SIGNAL 


A binary FM-PSK signal is a special case of the binary continuous- 
phase FsK modulation where the phase deviation in one signaling 
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PSK WITH RECTANGULAR SIGNALING 
AND FOUR-—POLE BUTTERWORTH 
TRANSMISSION FILTER 
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Fig. 4—Normalized power contained outside the band [—W, W_] for M-ary psk 
(M = 2%, N 21) with rectangular signaling and a four-pole Butterworth trans- 
mission filter. The squared amplitude characteristic of the equivalent low-pass filter 
is assumed to be given by |Hr(f)|? = 1/[1 + (f/A)8], where 2B = 2A (7 /8)/sin 1/8 
is the noise bandwidth of the filter. 


interval is 7/2 and which can be detected as a PskK signal. Note that 
one may use a four-phase demodulator to detect a binary FM-PSK 
signal* to have the same bit error rate performance as that of BpsxK.!4~16 

“A form of binary FM-Psk can be shown to be equal to the sum of two offset 
quadrature-phase binary psx signals. A form of it is, therefore, sometimes referred 


to as offset psx (Ref. 2). An rM-psk with rectangular frequency modulation signal- 
ing is called fast Fsk in Ref. 12 and sx in Ref. 14. 
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PSK WITH RECTANGULAR SIGNALING 
AND FOUR-—POLE THOMSON 
TRANSMISSION FILTER 
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Fig. 5—Normalized power contained outside the band [—W, W _] for M-ary psk 
(M = 2", N 2 1) with rectangular signaling and a four-pole Thomson transmission 
filter. The squared amplitude characteristic of the equivalent low-pass filter is as- 
sumed to be given by |Hr(f)|? = 11025/(z® + 102° + 13524 + 15752? + 11025), 
z= f/A and 2B = 4.4238A is the noise bandwidth of the filter. 


There are no discrete lines in the FM-PSK spectrum, but standard 
techniques (such as the Costas loop) can be used to recover the co- 
herent carrier (it is necessary to use differential encoding or prior 
knowledge of framing polarity, etc., to resolve the ambiguity present 
in the phase of the recovered carrier). 
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Fig. 6—Normalized power contained outside the band [—W, W_] for quaternary 
PSK with different baseband signaling waveforms. 


To get the spectral density of binary Fsk, we put 
ef (m/2) 
r(T)] = pia | (25) 


in (16), (17), and (19) for any baseband signaling waveform h(t). We 
assume that we transmit +1 by shifting the carrier frequency by 
+ fag(t), O<t3 7, and —1 by shifting the carrier frequency by 
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Fig. 7—Normalized power contained outside the band [—W, W ] for quaternary 
PSK with different baseband signaling waveforms. 


—fag(t),0 <t Ss T. For rectangular signaling, 


(26) 


| 
oe | Nas 


ji = 
and for raised-cosine signaling, 


fa = (27) 


bo] — 
ae | 


so that the peak frequency deviation with raised-cosine signaling is 
larger than that with rectangular signaling. 

From (16), (17), and (25) one can show that the spectral density 
P,(f) of binary rM-Psk is 
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1 + sin (2efT)} — ! eos (Qn fT) 
P.(f) = Pr(/) = pki Re, 


DOS. bo] 


cos (24 fT) ; (1 — sin (2xfT)} 


Ry 
ef 28) 
where #1, 2 are the Fourier transforms of 7,(¢), 72(¢) 
t 
nie exp | i2na I g(tat | : 0<tsT (29) 
0 ; otherwise, 
t 
m= exp | — 20 fe / a(tat| O.:< ea L (30) 
0 otherwise. 


For rectangular and raised-cosine signaling, we plot for binary 
FM-PSK the out-of-band power ratio A? in Fig. 8. The 99-percent (or 
any other fractional) power bandwidth occupancy may be determined 
from results given in this figure. 


Vi. TIME-LIMITED AND BAND-LIMITED SIGNALS 


We shall derive the lower bound on the band occupancy of binary 
PSK and FSK signals by using the results obtained for time-limited and 
band-limited functions. 

In their classical papers, Slepian, Landau, and Pollak have derived?’ 
the pulse waveform of given duration that has a maximum of its energy 
concentrated below a certain frequency band. These optimum pulse 
waveforms are the well-known prolate spheroidal wave functions. A 
widespread opinion is that pulses with minimum energy at high fre- 
quencies should have a rounded form with many continuous deriva- 
tives. Since the optimum pulses (the prolate spheroidal wave func- 
tions) are usually not continuous at the limits of their truncation 
interval, this opinion does not seem to be justified. In fact, Hilberg and 
Rothe” have shown recently that constraints of continuous derivatives 
tend to increase the total out-of-band energy. We shall now state the 
bounds given by Slepian, Landau, and Pollak. 


If we define 
totT’/2 
Ok. 
Ao to—T’/2 (31) 


[ ls@ ae 
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Fig. 8—Normalized power A? contained outside the band [—W, W] for binary 
FM-PSK with different baseband signaling waveforms and also the lower bound on A? 
for any baseband signaling waveform. 


and 


[ irm@pas : 
er = f soemerd, (82) 


p= 
[i ropa = 


it is shown in Ref. 9 that 


cos! (a) + cos! (8) 2 cos! Varo, (33) 
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where Xo is the largest eigenvalue of the integral equation 


MO = Pf re eh as (34) 


In (31), we assume that f(t) € £% where £% is the set of all complex- 
valued functions defined on the real line and integrable in absolute 
square [ f(t) has finite energy ]. 

In binary psk and certain binary FsK, we shall show that P,(f) or 
P,.(f) can be expressed as the energy density spectrum [| X(f)|?] of 
a certain x(t), time-limited to a duration 7..." From (31), if x(t) is of 
duration T'¢q, 

a = I, das Le 


B? S Xo a 


and the maximum value of #? 1s attained when x(t) is a prolate sphe- 
roidal wave function yWo(t, d) given in Refs. 8 and 9, d = WT... The 
fractional energy A? contained outside the band [—W, W ] is, there- 
fore, lower-bounded by 


A2=1— 6 21 — dro = Ain. (36) 


The values of A2i, computed from the relations given in Refs. 8, 9, 
and 18 are shown in Fig. 9. It therefore follows that it is impossible to 
find an £*-integrable pulse waveform x(t) which has a duration Tg and 
which has a fractional energy less than Azin(WT.q) outside the band 
Vil. LOWER BOUND ON THE BAND OCCUPANCY OF PSK AND 

FM-PSK SIGNALS 


Let us first consider the band occupancy of the continuous part 


P,.(f) of a BPsK spectrum. 
From (20) and (21), 
P,.(f) = |X(f)|?, (37) 


where X(f) is the Fourier transform of 
sin = 0(0| 
x(t) = ¢<—+7_ 
" WF 


0 ; otherwise. 


Ota! (38) 


In (37) we have expressed the continuous part of the spectral 
density of a binary PskK signal in terms of the energy density spectrum 


“In FM-PSK, it will turn out that T.q = 27', where T is the duration of the signaling 
waveform g(t). Hence, we use the symbol 7’. to denote the duration of x(t). 
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of an arbitrary pulse waveform x(t) € 2 C £%.* x(t) can be nonzero 
only for 0 <t ST. From Section VI, it therefore follows that the 
out-of-band power ratio A% of a binary Psxk signal is lower-bounded by 


A= Aim(WT), (39) 
where 


» _ Continuous power contained outside the band (—W, W) 
A‘ a mt pe aa kth ne Ee eT Ta ee a Se Ne ee Sea pee eae ay (40) 
Total power contained in the continuous part 


Note that A2 ~ A? or A’, but 


At _ Total power in P.(f) . , (41) 
AZ Total power in P,,(f) ~ 


Now A2 can be made equal to Azin(WT) by choosing 
a(t) = kWo(t — T/2, d), d = «TW, f aay be (42) 


where Y(t, d) is a prolate spheroidal wave function and k is a normaliz- 
ing constant.' We choose k so that the total power H contained in the 
information-bearing part P,,(f) [equivalently, the total energy con- 
tained in x(t) | is maximum. Since yo(t, d) is maximum at t = 0, £ is 
maximized by choosing 


2. 4 | volt — 7/2, d) 


0 (=-7> 
gi) =40™ | Od fe SSE (a8) 
| 0 : otherwise. 
For this value of g(t), 
= _ Ao ; 
E= FRO, a) 


For x(t) in (42) and g(é) in (48), the minimum out-of-band power 
ratio Atin(WT) can be attained, and 


For some values of d, the minimum out-of-band power ratio Anin(WT) 
and the maximum power contained in the continuous part are listed 
in Table I.8 The rest of the power in the psx signal is contained in 
P,,(f) or the discrete lines. For binary psx, it follows from Sec. VI and 
eqs. (89) and (42) that [A2|min is given in Fig. 9. 


*Since |x(¢)| S$ 1, note that © is a proper subset of £2. 

T Our letter d in Wo(t, d) corresponds to the letter c used in Refs. 8, 9, and 18. 

tg = Sin (x) denotes the principal value of the inverse sine, —7/2 S$ @ S 7/2. 

§ We chose the values of d given in Table I so that we can make use of the results 
given in Refs. 8, 9, and 18. 
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Table |— Minimum out-of-band power ratio of binary PSK 


Minimum : ; 
Maximum Normalized 
d = 1TW WT Out-of-Band Power Contaiied inthe 
Power Ratio Conti Part of P (f) 
A? (WT) oOntinuous Fa O » 
0.5 0.1592 0.6903 0.9730 
1.0 0.3183 0.4274 0.9015 
2.0 0.6366 0.1194 0.7122 
4.0 1.2732 0.00411 0.4736 


For d = 0.5, 1.0, 2.0, and 4.0, we plot the optimum g(t) from (43) 
in Fig. 10. For a(t) in (43) and Fig. 10, we plot the spectral density 
P,.(f) of binary psk in Fig. 11. 

From (11), A? = A? + A?, and since one eae peaks the total 
out-of-band power ratio, we list in Table II A?, A?, and A? for g(¢) in 
(43) and WT in Table I. Also for g(¢) in (43), we plot the éotal out-of- 
band power in Fig. 12. Comparing Figs. 1, 2, and 12, note that the 
total out-of-band power for the optimum pulse is very close to that for 
the rectangular pulse for 0 S$ 2WT <1. In the neighborhood of 


NORMALIZED MINIMUM POWER IN THE TAILS 


10-3 
0.5 1.0 1.5 2.0 2.5 3.0 3.5 
2WTeg 


Fig. 9—Lower bound on the fractional energy contained outside the band [—W, W] 
when the pulse f(¢) is of duration T'eq. 
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g(t) 





0 0.25 0.50 0.75 1.00 1.25 1,50 


Fig. 10—Phase modulation pulse g(é) for binary psk for optimum continuous 
spectral occupancy. 


2WT = 0, the total out-of-band power with the optimum pulse is 
greater than that with cosine, raised-cosine, triangular, or trapezoidal 
pulse. This is because the optimum pulse minimizes the fractional 
out-of-band continuous power and not the total power. For g(¢) in (48), 
it must be noted that the smaller the out-of-band continuous power 
ratio, the smaller the maximum amount of power contained in the 
continuous part. The rest of the power is contained in the discrete 
lines.* 
One must note that, in general, 


A? ad A? ‘ain( WT) (46) 
the total out-of-band power ratio (the total out-of-band power divided 


* The total out-of-band power with optimum pulse increases as a function of 2WT 
if we use the pulse in (43) and if 2WT > 2.5. This is because an increasingly large 
amount of power is contained in the discrete lines and the total out-of-band discrete 
power very much dominates the out-of-band continuous power. By choosing the 
pulse which is optimum for 2WT S 2.5, we can make the total out-of-band power a 
monotone-decreasing function of 2W7’. 
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Fig. 11—Continuous spectral density P,,(f) of binary psx for optimum continuous 
spectral occupancy. 


by total power) is not equal to the out-of-band continuous power (the 
out-of-band continuous power divided by power contained in the con- 
tinuous part). Also note that we have obtained a lower bound on 
Azin(WT) and not on A®. Since any time function y(t) containing 
discrete lines does not belong to £2, analysis given in Refs. 8 and 9 
does not enable the optimization of A’. 

Our efforts to find a lower bound on the total band occupancy of a 
BPSK signal have not been successful so far, and it is suggested as an 
interesting problem for the reader. 

So that we may compare the spectral occupancy of binary psk with 
several different modulation pulses for A? = 0.1, 0.01, and 0.001, we 
list in Table III the values of 2WT. 

Let us now consider a @Psk signal. From (22) one can show that no 
single function x(t) can be found such that its energy density spectrum 
|X (f) |? is equal to P,,(f). If 2WT is large so that a small amount of 
total power is contained in the tails, we feel that the total out-of-band 
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Table Il —— Total out-of-band power ratio for binary PSK with g(t) given by (48) 


Normalized 

Power Con- 

tained in the 
Continuous Part 


Normalized 

Power Con- 

tained in the 
Discrete Part 


Minimum 
Out-of-Band 
Continuous 


Power 


0.6717 
0.3853 
0.08506 


0.001943 


Out-of-Band 
Discrete 


Power 


0.00668 
0.02368 
0.06258 


0.00721 


Total 
Out-of-Band 
Power Ratio 

A2 


0.009153 


Normalized Power in 
the Lines at Frequency 
n/T from the Carrier 


ss3a3s 


ooooe 


3 


I 


0.02024 
0.07483 
0.2252 
0.4364 


0.04139 


BINARY PSK 


No 


—-s 
S 
aa N 


NORMALIZED TOTAL POWER IN THE TAILS 
> 





0 2 4 6 8 10 12 
2WT 


Fig. 12—Normalized total power contained outside the band [—W, W] for g(é) 
in (43). Observe that the total out-of-band power for g(t) in (48) increases (see the 
dashed portion of the figure) as a function of 2WT for 2WT > 2.5. This is because 
the total out-of-band discrete power, which is not optimized, very much dominates the 
out-of-band continuous power. Note that g(t) in (48) only minimizes the fraction of 
the continuous power contained outside the band [—W, W]. For 2WT > 2.5, by 
choosing g(é) which is optimum for 2WT7T S 2.5, we can make the total out-of-band 
power decrease as a function of 2WT. 


power for a QPSK signal is lower-bounded by the results given for a 
BPSK signal. The band occupancy of apsK for A? = 0.1, 0.01, and 0.001 
for different modulation pulses is listed in Table IV. 

We now derive a lower bound on the total band occupancy of an 
FM-PSK signal. In (29) and (80), g(t) € £% is assumed to be completely 
arbitrary. 


By defining 
eit T—a/4) 4. pi (af T—1/4) 
R, = j2 oo Ry, (47) 
ei (af T—a/4) — pi (af T-1/4) 
R, = j —_*—"—_R,, (48) 


we can show from (28) that 


Pf) = 7 [Ry — Ral? = [XI (49) 
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Table Iii— Values of out-of-band power ratio A? for binary PSK 
with different baseband modulation pulses 


Pulse 
g(t) 
gt)=0,t(S0,t>T 


Rectangular 
g(t) =1,0 <t 
Trapezoidal 


IIA 


Loe tee 
‘a 4 
a{ t+ x) = 

2(1-=r ), 
Triangular 


T 
(t+ 5) =1- 


0<|t}]s 


2|t! 
7" 


< 





di 
4 


2|é| 
T 





L 
2 
Cosinusoidal 


T 
(t+ 5 ) = cos 


Raised-Cosinusoidal 
1 2Qrt 
g(t) = 5 ( 


1 — cos =r 
0<tsT 


Total Out-of-Band 
Power Ratio A? 











Normalized 
Power 

Contained 0.1 0.01 0.001 

in Ps (f) 
2WT | 2WT | 2WwTr 

1.000 1.807 | 19.295 
0.750 2.000 4.000 | 8.000 
0.500 2.000 3.283 | 6.000 
0.652 2.000 3.744 | 6.246 
0.500 2.000 2.958 | 4.904 


Table IV — Values of out-of-band power ratio A? for quaternary 
PSK with different baseband modulation pulses. 
Expressions for g(t) are given in Table III 


Normalized 
Pulse Power 
g(t) Contained in 

P,,(f) 

Rectangular 1.000 
Trapezoidal 0.769 
Triangular 0.538 
Cosinusoidal 0.682 
Raised-Cosinusoidal 0.526 


Total Out-of-Band Power Ratio A? 


0.1 0.01 0.001 
2WT 2WT 2WT 
1.807 19,295 
2.000 5.389 8.672 
2.000 3.651 6.274 
2.000 3.839 6.270 
2.000 4.000 5.491 
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where X(f) is the Fourier transform of x(t) and 


l t 
FC | wha g(p) ut : O<itsT, 


“i 008 [2a [ 


‘a : otherwise. 


a "(udu » Lsts27, (50) 


Since x(t) may be nonzero only over an interval (0, 27) it follows that 
the minimum out-of-band power ratio A? of a binary FM-PSK is lower- 
bounded by* 

A? > A2n(WTea), Te = 27, (51) 


where Ajin is defined by (45). For 2WT > 1, one can show’ that 
3 
64rWT 


A? = Atin(QWT) ~ 4rv2WT (1 ) exp (—4rWT). (52) 


Note that x(t) is not completely arbitrary over the interval (0, 27). 
From (50) one can show that if 


ei) =ar(t), O<tsT, (53) 


One i ~a(t-T), T<ts<2v7. (54) 


Equations (25) and (50) also yield 


then 


x(0) = 0 (55) 
and 
= 


When x(t) € £% is completely arbitrary, the lower bound in (51) 
is attained when 


x(t) = k¥o(t — T, d), =~2TW, T'=27, (57) 


where Wo(t, d) is defined in Section VI. Any function other than (57) 
has a larger out-of-band power ratio. Since x(t) in (57) does not satisfy 
(53) to (56), it follows that the bound in (51) is strictly a lower bound 
and is not attainable.t 


“Note that there is no discrete power contained in an FM-Psk signal. 

The derivation of an attainable lower bound is extremely complicated and will 
not be attempted here. Also, Table V shows that rectangular signaling gives a band- 
ee occupancy which is very close to the lower bound when A? ~ 0.01, the region 
of interest. 


SIGNAL SPECTRAL OCCUPANCY 451 


Table V — Values of the lower bound on 2WT and of bandwidth 
occupancy for binary FM-PSK with rectangular 
and raised-cosine signaling 


Raised-Cosinusoidal 


Rectangular 1 Ont 
eos | 9O=1, | o@) = 5(1 - cos), 
oo 0<tsT Lower 
0<tisT 
= Bound 
(Peak-to-Peak Frequency 
Deviation) X T 0.5 1.0 2WT 
Out-of-Band Power Ratio A? (Bandwidth Occupancy 2W) xX T 
0.1 0.773 0.930 0.675 
0.01 1.170 2.200 1.117 
0.001 2.578 2.874 1.517 


The values of the lower bound on 2WT and of band occupancy of 
binary rmM-psx for A? = 0.1, 0.01, and 0.001 with rectangular and 
raised-cosine signaling are listed in Table V. The lower bound on A? 
given by (51) is also plotted in Fig. 8. Note that the lower bound is very 
close to A? with rectangular signaling for 1 S A? S 0.01. 

Note that the bandwidth occupancy of binary FM-PSkK with rectan- 
gular signaling is smaller than that with raised-cosine signaling if 
A? = 0.001.* Note also that the peak-to-peak frequency deviation with 
raised-cosine signaling is larger than that with rectangular signaling. 
The phase deviation in one signaling interval is always +7/2. 


Vill. CONCLUSIONS 


For binary and quaternary psk systems, the band occupancy results 
presented here can be combined with the results given in Ref. 7 so 
that channel bandwidth and channel spacing can be chosen to produce 
minimum distortion transmission and to satisfy any specified power 
occupancy criterion. The band occupancy of Psk with overlapping 
baseband pulses is known to be narrower, but we have not considered 
such signals in this paper. 7 

The 99-percent power occupancy bandwidth of an FM-pPsxk signal 
with rectangular signaling 1s shown to be only 4.7 percent higher than 
the lower bound. The channel spacing requirements of FM-PSK, from 


“The tails of the rM-psk spectra with raised-cosine signaling go as ~1/f8, with 
rectangular signaling as ~1/f4. Hence, the bandwidth occupancy with raised-cosine 
signaling becomes smaller than that with rectangular signaling for small enough 
A? (A? < 7.5 & 1074). 
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the point of view of distortion produced by adjacent channel inter- 
ference, will be treated in subsequent work. 

An attempt is also being made to derive a lower bound on the band 
occupancy if the total power in the continuous part of a BPSK signal 
is a specified fraction of the total RF power. 
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A Touch-Tone® Receiver-Generator With 
Digital Channel Filters 
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A Touch-Tone® receiver with cyclotomic digital channel filters intro- 
duced in a companion paper is presented in this paper. A comparison 
with standard digital channel filters reveals that the number of additions 
per second needed to implement the channel filters 1s significantly reduced 
using cyclotomic filters. The performance of cyclotomic filters as a function 
of thetr period is presented in graphic form. The results presented here 
semulating the filter with random inputs indicates that the filters can 
effectively reject non-Touch-Tone signals. Sensitivity of some tmportant 
criteria as a function of the accuracy of the clock used to control the digital 
filters 1s summarized. The results show that the filters are not particularly 
sensitive to nonaccurate clocks. 


l. INTRODUCTION. 


In Ref. 1 we describe a family of filters with several advantages over 
existing filters, which can be used to generate and detect single tones. 
Here, we describe how such filters can be used in the construction of 
a Touch-Tone® receiver. 

The standard TJouch-Tone receiver is described in Ref. 2; many 
other receivers have been proposed in the literature; one which is 
completely digital is described in Refs. 3 and 4, and an analog receiver 
with a digitally controlled center frequency is described in Ref. 5. 
The basic Touch-Tone telephone must generate tones to identify the 
ten basic possible inputs (1, 2, ---, 9, 0) or, in the case of augmented 
telephones, 12 to 16 possible inputs (including, for example, * and #). 
This is done by arranging the input buttons in a grid of four rows and 
three or four columns. Associated with each row is one of four ‘‘low”’ 
frequencies (697, 770, 852, or 941 Hz), and associated with each 
column is one of three or four high frequencies (1209, 1336, 1477, or 
1633 Hz). When a button is pushed, one low and one high frequency 
are simultaneously generated, corresponding to the row and column 
in which the button is situated. In the central office, a detector decodes 
the incoming pair of tones to determine which button was pushed. 
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An incoming signal first passes through a series of tuned filters that 
filter out dial tones, ring tones, busy tones, and power harmonics 
(which have amplitude too large to be accommodated by the subse- 
quent channel filters). Next, the signal passes through two parallel 
bandpass filters (BrF) (see Fig. 1), one to reject the four high-frequency 
tones (low BPF) and one to reject the four low-frequency tones (high 
BPF). The output of each BPF passes through a limiter, and the limited 
signal passes through four parallel channel filters. Each channel filter 
is connected to a threshold detector which, in 40 ms, makes a deter- 
mination of whether the tone was present or absent. 

In analog receivers, the most critical section consists of the channel 
filters. Hence, these have to be made with precision components to 
meet the specifications for station sets. Use of a completely digital 
receiver requires analog-to-digital (A-to-D) conversion, and special 
care has to be taken to avoid problems caused by roundoff errors in 
the BPFs. Furthermore, use of the receiver to generate Touch-Tone 
signals leads to unwanted limit cycles, impairing performance (see 
Ref. 6). 

We propose here a hybrid receiver based on the cyclotomic filters 
presented in Ref. 1. In the hybrid receiver, the filters that attenuate 
the dial tone, etc., are the standard analog filters which, using Rc 
active circuitry, can be integrated.* The digital part of the receiver 
follows the limiting circuits (see Fig. 1), which in this case are hard- 
clippers, thus eliminating the need for separate A-to-D conversion, 
and at the same time replacing a significant portion of the receiver by 
digital circuitry. The analog part need not be made with precision 
components, since variation in the gains of the bandpass filters does 
not affect the output of the hard limiter significantly. Only the sign 
of the outputs of the BPrFs are used in the digital part of the receiver. 
The digital filters in the receiver are all operated with perfect arith- 
metic. All channels have identical filters operating on samples of the 
output of the hard limiters. However, for each channel, the sampling 
frequency is proportional to the channel frequency. 

Some important features of the system can be summarized as 
follows: 


(2) Compared to the channel filters in the all-digital receiver 
presented in Ref. 3, the number of additions needed to detect 
tones is relatively small. Hence, fewer adders are needed. 

(2) All digital channel filters are mechanized with perfect arith- 
metic, thus avoiding problems of roundoff. 

(272) Since we use perfect arithmetic, we can also generate Touch- 
Tone receiver frequencies using the same channel filters in the 
recelver. 
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(zv) Without using any A-to-D conversion, we use digital channel 
filters with analog BPFs. 

(v) By resetting the filters periodically, we lessen the chance that 
noise during inter-digit silences, or residual ring tone signals 
before the first digit, will affect performance. 

(vz) Since the channel filters have infinite Q, it is possible to increase 
the signaling rate. 

(viz) Although the filters have infinite Qs, the peak-to-threshold 
rejection is kept below 3 dB, thus still preserving the guard 
action of the hard limiters. 


We assume that the reader is familiar with Refs. 1 and 2. Section II 
gives a description of the hybrid receiver. Section III deals with the 
performance of the channel filters. Some remarks concerning the factors 
that enter into choosing the period of cyclotomic filters and interval of 
operation are contained in Section IV. 


Il. DESCRIPTION OF THE HYBRID RECEIVER 


Figure 1 is a block diagram of the general receiver. The structure of 
the hybrid receiver is very similar to the standard receiver which 1s 
described in Ref. 2. The analog part of the receiver includes both the 
BP¥Fs and the filters which attenuate power harmonics, ring tones, etc. 
The outputs of each BPF go into hard-limiters, which convert the analog 
output of the BPrs into a signal which is either +1 or —1, depending 
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Fig. 1—General receiver. 
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on whether the analog signal is nonnegative or negative, respectively. 
This entire analog part can be integrated using active RC circuitry 
(see Ref. 4). The channel filters which follow the hard-limiters (see 
Fig. 1) are identical cyclotomic filters (see Ref. 1 and Fig. 2). The 
cyclotomic filter for each channel has as its input the output of the 
hard-limiter sampled at a rate p times the channel frequency, where p 
is the period of the cyclotomic filter used. This requires clock pulses 
of different frequencies for the different channels. 

The channel filters are run periodically for an interval of time in- 
versely proportional to the channel frequency, called the interval of 
operation. At the beginning of each such interval, the filters are set to 
zero. The magnitude of the output of each of the filters is compared 
with a fixed threshold; when the magnitude exceeds this level, a tone 
corresponding to this frequency is assumed to be present (during the 
entire interval of operation). The length of the interval of operation is 
dependent on the permissible error. An interval of operation corre- 
sponding to seven cycles of the channel frequency was found to be 
sufficient (see Section 3.2). This corresponds to 10 ms for the channel 
corresponding to the lowest Touch-Tone frequency, 697 Hz. Hence, 
if the 697-Hz channel tone is present for the required 40 ms (Ref. 2, 
p. 11), then in at least three consecutive intervals the tone will produce 
a signal above the threshold. For higher frequencies, the interval of 


p x 770 Hz 


p x 697 Hz 
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FILTERS DETECTORS 
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Fig. 2—Channel filters of the low group. 
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operation is shorter. By synchronizing the intervals of operation of 
all channels, testing 1s made for the simultaneous presence of a high 
tone and a low tone. When a high tone and a low tone are each present 
for three consecutive intervals, a valid Touch-Tone signal is assumed 
to be present. The digit corresponding to a pair of tones is decoded in 
the standard way, as described in Section I. Modification of the ele- 
mentary decision process could be made to increase the signal rate, 
since the interchannel rejection achieved in a single operating interval 
is sufficient (see below). 

We will not be concerned here with details of hardware in the 
mechanization of the receiver, but will describe some ways in which 
the computations in the channel filters can be performed in a multi- 
plexed system. 

Two basic modes of implementation will be discussed. One involves 
individual channel filters dedicated to a fixed frequency. These could 
be multiplexed to receive inputs from many sources (Fig. 3). This 
may be more useful in central office applications, where a substantial 
number of Towch-Tone receivers have to be operating at the same time. 
In this case, the channels controlled by the same clock can be mul- 
tiplexed in the usual way using serial arithmetic as described in Ref. 1. 
A system of 20 receivers would require eight clocks (or clock pulses 
derived from a simple high-frequency clock). For a system using, for 
example, six times the channel frequency as sampling rate, one adder 
per channel seems adequate. From Table II, Ref. 1, computations show 
that the cyclotomic polynomial of period 6, F's, needs 84 adds per 
period. The channel corresponding to the highest frequency, 1633 Hz, 
will need (1633 X 84 X 20) adds/s. This implies that an add must 
not take more than about 0.36 us. So, with 0.36-us adders, eight adders 
would be needed for the whole system. This is, of course, excluding the 
logic involved in the decision process. If in the system we allow for 
buffers in the higher frequency channels, then a slower adder could be 
used, since we wait 10 ms before a decision is made. In this case, the 
speed of the adder is determined by the channel corresponding to the 
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Fig. 3—System amenable to serial multiplexing. 
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lowest frequency. The lowest frequency channel requires (697 X 84 
x 20) adds/s, corresponding to an add in ~ 0.85 us. 

Another system involves buffering the input in such a way that a 
single filter can be used for two or more channels (Fig. 4). This might 
prove useful when an adder is mutliplexed between channels corre- 
sponding to the same receiver. In this case, buffers for each channel 
store the output from the limiter in segments corresponding to the 
seven-cycle interval of operation. For the filter based upon F's, this 
would be 42 bits long. Since the buffer corresponding to a higher 
frequency would fill up faster than one corresponding to a lower fre- 
quency, the channel corresponding to the highest frequency, 1.e., 
1633 Hz, is fed into the filter first, say, after 5 ms (the buffer of this 
channel fills up in less than 5 ms). After completing the operation on 
all the 42 bits of input of this channel, the filter is multiplexed to op- 
erate on the next highest frequency channel, and so on. This requires 
that the adder be fast enough to do 7 X 84 adds in less than 2 ms, 
i.e., 940,800 adds/s so a l-us adder would suffice. Since this adder is 
idle for every 5 ms of the 10-ms cycle, it can be used for another re- 
ceiver. Hence, a l-us adder could do all the additions for the channel 
filters of two receivers. Modification of this elementary decision 
process could be made depending on the statistics of noise in the 
channel and sensitivity of the limiter. When a high and a low tone 
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have been simultaneously detected for three consecutive 10-ms periods, 
then a decision is made that a Touch-Tone signal has been received 
and the digit is identified in the usual way. The regular second-order 
filter used in the all-digital receiver of Ref. 3 requires a minimum of 
2400 adds/ms and a total of 96,000 adds and achieves an interchannel 
rejection of ~ 7 dB. Using. a cyclotomic filter of period 6 (based on F's) 
would require 840 adds to give the same interchannel rejection. This 
corresponds to a rate up to 60 adds/ms for the 697-Hz channel. If the 
period were raised to 30 and no use of read-only memory were made, 
it would still only require a maximum of 56,700 adds to achieve the 
same rejection; this corresponds to approximately 4010 adds/ms. Of 
course, intermediate periods would give intermediate statistics, which 
can be readily computed for systems based on F’, (p = 8, 9, 12, 15, 
16, 18, 24; see Ref. 1). 


Ill. PERFORMANCE OF THE CHANNEL FILTERS 


To discuss the performance of the channel filters, we need to define 
certain terms. Let f;,7 = 1, 2, ---, 8 be the eight channel frequencies. 
As described earlier, each channel filter is a cyclotomic filter of some 
period p, based on the cyclotomic polynomial F',. The order of the 
filter is denoted by k (the degree of /’,). The fundamental resonance 
frequency of each filter is determined by 7;, the sampling interval in 
seconds of the output of the hard-limiter. In order that the fundamental 
resonance of the filter be at frequency f:, 7; should satisfy 


jee 
t i 


From Ref. 1 we see that the operation of any channel filter can be 
modeled by 


k 
Ln = a» Cer Un 
=) 


k 
Yu De Cees n=0,1,---,N 
=I 


x; = 0 for 7 <0, 


where %n_:i, 7 = 1, ---, k are the numbers stored in the shift register 
implementing the particular channel filter, y, the output of the filter, 
and u, the sampled output of the hard-limiter, which is, of course, the 
input to the filter. Hence, if the output of the BPF is a sinusoid of fre- 
quency f, 

the HA if sin 2anfr 2 0 
—] if sin 2anfr < 0, 
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where 7 is the sampling interval associated with the channel. So that 
we may use the same threshold for all channels, we normalize the 
interval of operation by the fundamental resonant frequency. Hence, 
if each filter is operated for N steps, this corresponds to operating the 
filter for Nr; s. N/p describes the same interval in units corresponding 
to a period of the fundamental resonant frequency, hence, an interval 
of operation of seven periods of the fundamental, i.e., 7-1/f;s. We will 
compare performance of cyclotomic filters of different periods operating 
for the same number of periods of the fundamental. 

Let M(f) denote the maximum absolute value of yn in the interval 
of operation when the input square wave is of frequency f. Detection 
of the fundamental frequency is based on M (f) exceeding a preassigned 
threshold. A plot of M(f) vs frequency for various cylotomic filters 
when operated for seven periods of the fundamental is given in Ref. 1. 
The curves serve to indicate how well the filter performs in distinguish- 
ing between tones. The model of a typical curve is shown in Fig. 5. 
Following standard terminology, we use the term power gain or gain 
at f to mean 20 logis M(f). Difference between power gains at two 
frequencies is related in the obvious way to the ratio of M?(f) at these 
two frequencies. By scaling the frequency axis linearly, the funda- 
mental resonant frequency can be shifted arbitrarily. The specifica- 
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Fig. 5—Specifications for a typical channel. 
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tions (see Ref. 2, p. 11) for the Touch-Tone receiver require that any 
tone of frequency f lying in the interval J; defined by f; = 0.987f; 
—4< f51.013f:+4= fj} be accepted as a tone corresponding 
to frequency f;. This band of frequencies is referred to as the accept 
band of channel z. The threshold 7’; has to be set such that M(f) > T; 
for all f in the accept band. Therefore, 7; S Miny-<s<s+M(f). We 
call 20 logio J; the ‘‘maximum threshold” for channel z. On the other 
hand, 7; has to be greater than M(f) for f € J;, 7 #7. We call A; 
= [Max;z: M(f;)] the ‘maximum gain at reject channels.” If the 
gain at any other channel j exceeds 7’;, then a tone corresponding to 
channel 7 could be mistaken as one corresponding to zt. The threshold 
with 3-dB rejection is merely 20 logiy A; + 3. Use of this threshold 
assures that if the input to channel 7 is a signal corresponding to some 
other channel, then the signal level in the filter is at least 3 dB below 
threshold. Finally, the “‘rejection at edge” is the measure of the maxi- 
mum drop in signal level at the edge frequencies fj and f;* from the 
center frequency fy. 

Evidently, these parameters are different for different channels. 
However, by setting certain standards for a typical threshold and 
maximum reject channel gain, a worst-case standard set for the whole 
receiver can be found to compare the performance of cyclotomic filters 
of different periods. It is easily seen that J; is contained in the interval 
[0.98f;, 1.02f;]; on the other hand, this interval is not significantly 
bigger than J; for any j. For each channel frequency f;, every f;j7 ¥ 1 
lies outside the interval [0.91f;, 1.09f;]. The rejection of every alien 
channel is greater than the rejection of frequencies at ends of this 
interval because of the bell-shaped nature of the curve in the intervals 
of interest. 

Now that the ends of the intervals of interest have been scaled with 
respect to the resonant frequency, we can define 


T = Min [M/(0.98f,), M(1.02f;) ] 
A = Max[M(0.91f;), M(1.09f;) ]. 


Then 20 logio 7 and 20 logio A serve as standards for threshold and 
maximum reject channel gain for all channels. Figure 6* is a plot of 
M(f:), T, and A for cyclotomic filters of periods 6 through 30, run for 
seven periods of the fundamental resonant frequency. Although the 
T and A as a percentage of M(f;) do not change appreciably as the 
period of the filter increases, the effect of increasing the period of the 
cyclotomic filter is not equivalent to scaling the input to the filter. 


| 


*In Fig. 6, O, +, and O correspond to M(f;), T, and A adjusted for phase 
shift of input signal as described in Section 3.2. 
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Fig. 6—Performance vs period. 


This is because filters of larger periods assume a larger number of dis- 
tinct levels. Furthermore, increasing the period of the filter may be a 
way of reducing the effect of noise at the limiter as described in Ref. 1. 
Although rejection in decibels is a conventional method of describing 
performance of the tuned filter, the actual level of the signal may be 
more pertinent to digital applications; hence, the plot is a linear scale. 
We can now discuss some specific aspects of the performance of these 
filters. 
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3.1 Higher-order resonances of filters 


Since the channel filters are discrete-time filters, spurious resonances 
could affect performance, especially since the inputs are hard-clipped, 
and hence have all odd harmonies (see Ref. 1, Section III). The higher 
harmonics introduced resulting from clipping could interfere with the 
fundamental. However, for a cyclotomic filter with transversal weight- 
ing function (see Ref. 1) of period p, the spurious resonance closest to 
the fundamental resonant frequency is (p — 1) times the fundamental. 
Hence, for example, for p = 6 (the lowest period considered here) the 
closest spurious resonance is five times the fundamental. Therefore, 
for the channel corresponding to the lowest Touch-Tone frequency 
(697 Hz), the first spurious resonance occurs at 3485 Hz, well outside 
the Touch-Tone band. The higher the period of the cylotomic filter, 
the further away this resonance will move. 


3.2 Interchannel rejection 


It was observed above that the ratio T;/A,z + j was greater than 
T/A for all channels. Hence, the minimum interchannel rejection is 
greater than 20 logiy (T/A). We will use 20 logio (7/A) as a measure 
of interchannel rejection. The interchannel rejection for all filters of 
periods between 6 and 30 varies between 4.2 and 4.9 dB. This is predi- 
cated on the assumption that the tone was synchronized with the 
switching on of the filter. This, of course, need not be the case in prac- 
tice. Hence, this figure was adjusted for the worst-case phase differ- 
ence between switching on of the receiver and zero of the time signal. 
Calculations showed that in all cases the rejection was not lowered by 
more than 0.5 dB for all filters. The values shown in Fig. 5 are cor- 
rected for worst-case phase difference. By increasing the interval of 
operation to 10 periods of the fundamental, the minimum interchannel 
rejection for all channels can be increased to about 7 dB. If the interval 
of operation is of the form (m+ 3) periods of the fundamental for 
any integer m, no correction for phase shift seems to be necessary. 


3.3 Sensitivity to clock rate 


Some important parameters of the filters corresponding to each 
channel as a function of percentage variation in sampling rate was 
calculated. The results when cyclotomic filters of period 6 are used for 
seven cycles of channel frequency show that with a threshold set at 
28 dB above the unit signal level of the hard-clipper, a +-2-percent 
change in sampling rate can be tolerated. Hence, even though we have 
to use eight different clock pulses, these clock pulses do not have to be 
controlled especially accurately. For cyclotomic filters of period 30, 
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the largest period considered in Ref. 1, similar observations can be 
made based on computational results. It can be deduced then that the 
performance of the channel filters are not especially sensitive to clock 
rate. This allows for the use of cheaper clocks, when each channel is 
clocked separately. 


IV. REJECTION OF PSEUDO TOUCH-TONE SIGNALS 


Whenever the input to the hard-limiter is a sinusoid, M(f) gives 
an indication of the signal level in the filter. However, when no 
Touch-Tone signal is present, the output of the BPrs are not sinusoids. 
Owing to the nonlinear nature of hard-limiting, the curve on Fig. 5 
does not lend significant insight into the signal level for complex 
signals. To simulate a family of non-Touch-Tone receiver inputs to the 
filter, we modeled the output of the hard-limiters as a two-state sym- 
metric Markov chain such that the average number of changes of sign 
in the interval of operation was equal to the number of changes of sign 
of a tone corresponding to the channel frequency. Then a simulation 
of the filter operating on such inputs was made. The noise level was 
about 12 dB below the level in the accept band for all cyclotomic filters 
of periods 6 through 30. 


V. SOME REMARKS ON THE CHOICE OF INTERVAL OF OPERATION 
AND PERIOD OF CYCLOTOMIC FILTERS USED 


As mentioned earlier, an interval of operation corresponding to seven 
periods is sufficient to provide adequate interchannel rejection. Hence, 
for signaling it is possible that a 20-ms on-time requirement for tones 
might be sufficient. In this case, one can eliminate the need for bandpass 
filters by altering the signaling process somewhat. Instead of trans- 
mitting two tones simultaneously for 40 ms, the tones can be sent one 
after the other, each being 20 ms at present. However, it would be 
necessary to determine whether this scheme can provide adequate 
speech immunity. This would reduce the number of channel filters to 
four, since only one frequency from the two groups of frequencies 1s 
present at a time. Because of simplifications effected in the receiver, 
this method of signaling might prove more useful for transmitting 
information using J'ouch-Tone signaling. 

As for the period of the cyclotomic filter used, it is clear from Table 
IJ, Ref. 1, that the number of adds/s increases as the period increases. 
However, depending on the signal-to-noise ratio at the input to the 
hard limiter, the use of a period high enough to make the frequency 
of errors in detection small might be necessary. 
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Digital Single-Tone Generator-Detectors 
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A class of digital, linear generator-detectors, based upon cyclotomic 
polynomials, which have simple twmplementation and operate without 
roundoff errors, ts proposed. It is shown how these filters are optimal among 
all linear generator-detectors which have no roundoff required in the feed- 
back loop. The complexity of various cyclotomic filters are compared. 
These filters in general require far fewer binary adds/s than conventional 
second-order filters used for the same purpose. 


I. INTRODUCTION 


Devices for pure tone generation and detection have widespread 
applications. The most notable examples are Touch-Tone® signaling, 
frequency shift keying (FskK), and multifrequency (MF) signaling. 
Associated with such devices are problems of stability and predict- 
ability, which in practice are dealt with on an individual basis, using 
techniques peculiar to the particular application. When these devices 
are realized digitally, the above problems are manifest from errors due 
to operational roundoff. 

Generally, tones for signaling are analog signals of the form A sin wé 
(A is the amplitude, 27/w is the period, and w/2z is the frequency). 
Devices that generate these tones are usually oscillators of various 
kinds. Because of the requirement of structural stability, in practice 
these devices are limit cycle oscillators. These are simulations and 
realizations in hardware of nonlinear differential equations that have 
limit cycles. Because of the complexity of these equations, the ampli- 
tude and frequency are not easily predicted from given values of resis- 
tors and capacitors in the network. 

For detection of these tones, linear analog filters are frequently used. 
These are also used as generators, when the duration of the signal is not 
too long compared to the period. However, passive linear analog oscil- 
lators require inductors which are bulky, and the frequency and 
amplitude of these oscillators can vary with changes in value of the 
inductors and capacitors due to environmental conditions. Active 
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linear oscillators using rc elements are used in many - applications. 
However, they also generally need some form of limiting and end up 
being nonlinear devices, thus usually preventing them from being used 
as receivers. 

Digital oscillators, on the other hand, are almost insensitive to chang- 
ing parameter values and produce stable repeatable waveforms. How- 
ever, in the mechanization of these oscillators (which are usually 
based upon second-order linear equations), roundoff in multiplication 
and addition produce errors in the feedback that lead to limit cycles 
and can significantly impair the signal quality. Also, when such linear 
digital devices are used as receivers, the precision required for satis- 
factory performance goes up quite rapidly with increasing Q. Although 
the effects of this can be satisfactorily controlled in certain specific 
applications (see, for example, Ref. 1), the difficulties, in general, can- 
not be ameliorated except by increasing the accuracy of computations.’ 

In this paper, we present a class of digital filters that operate without 
arithmetic roundoff. These filters are linear, and can be used both as 
oscillators for signal generation and also as receivers for signal detec- 
tion. The feedback loop of each filter is constructed in such a way as 
to eliminate the possibility of roundoff or truncation errors, thus insur- 
ing perfect arithmetic. This entirely eliminates the problem of limit 
cycles. The filters presented, when used as generators, produce quan- 
tized values of A sin wt of arbitrary accuracy. Implementation of these 
filters as receivers involves first sampling an analog input signal to 
produce a digital input into the filter. The filter is designed to resonate 
for a particular input frequency, thus enabling detection. 

The means by which arithmetic errors are eliminated in the feedback 
loop involves constraining all feedback coefficients to be integers (a 
constraint which turns out to be necessary to guarantee perfect 
arithmetic in any digital filter). Thus multiplication by these coeffi- 
cients can be performed as additions, simplifying implementation. 

The behavior of the feedback loop of this filter is modeled by a linear 
recursion whose characteristic polynomial is a cyclotomic polynomial. 
In recognition of this, we call the filter consisting of the feedback loop 
alone a ‘‘cyclotomic filter.’”’ It will be demonstrated that the only way 
to ensure perfect arithmetic with no limit on the period of operation 
(and thus avoid limit cycles) in a filter modeled by a linear recursion 
(i.e., a linear digital filter) is to constrain the feedback coefficients to 
be integers. Furthermore, it will be shown that, with this constraint 
on the feedback coefficients and also subject to minimizing memory 
and eliminating as many resonant harmonics as possible, the cyclotomic 
filter is uniquely optimal among all digital linear filters, both for the 
purpose of tone generation and the purpose of tone detection. 
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In subsequent sections of this paper, it is demonstrated how a 
weighting function can be applied externally to the cyclotomic filter 
to drastically reduce the impact of those higher-order resonances that 
remain. This is applied also to determine those impulse responses 
which have a small number of integer levels and lack higher-order 
harmonics. All the cyclotomic filters of practical significance, along 
with their associated weighting functions and impulse responses, are 
examined. 

In Ref. 3, a specific proposal is described for the T’ouch-Tone receiver 
(and tone generator), utilizing eight cyclotomic filters. 


Il. CYCLOTOMIC FILTERS 


The purpose of this filter, as discussed in Section I, is to generate or 
detect a single pure tone u(t) = A sin (2Q27ft+ yg) of frequency f. 
Digital implementation involves realizing a discrete time filter with 
k stages of memory (see Fig. 1), which is described recursively in terms 
of an input sequence wu, as 


k 
Ln = Do) Ani + Un. (1) 
i=] 


The numbers a;(2 = 1, ---, k) are the feedback coefficients of the 
filter. The filter is driven by a clock with the time interval 7 between 
pulses. In tone generation, the filter must satisfy 


Ln = u(nr), (2) 


at least for some initial conditions zo, --:, 2,1. When used as a 
receiver, the analog input u(¢) is sampled, producing a discrete input 
un = Asin (22fn7 + ¢); the filter (1) must distinguish between the 
desired frequency fo and all other frequencies in a band containing fo. 





Uy, 


Fig. 1—Recursive filter in k stages of memory. 
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Specifically, it must satisfy the resonance property 
lim sup |z,| = @, (3) 


when f = fo, and in a sufficiently large band B including f> there must 
be no other such resonances. Then |x,| will be uniformly bounded in 
B in the complement of any small interval 6 about fo, say, |x| S m(6) 
for all f € B, f & 4, for all n. A threshold detector can thus detect in 
a finite amount of time N7, the presence (or absence) within B of an 
input frequency fo (with error +4]|6|). It does this by comparing the 
gain supnsw |¢n| with the bound m(6);if sup |2,| > m(6), then f € 4; 
otherwise it is not. Of course, the smaller the allowable error 6, the 
larger N must be. 

To know precisely when an input wu, will resonate with respect to 
this filter, we first observe that the general solution to (1) is 


n k ; 
Ln = é os bip?7u;, (4) 
j=0 1=1 
where pi, -*:, pz are the roots (assumed to be distinct) of the charac- 
teristic equation 
k 
AF — DS aArtt = (5) 
t=1 
and b,, ---, b, are complex functions of the roots. [This is derived in 


(17) below. ] If the magnitude of a root of (5) is greater than 1, the 
filter will be unstable. However, if all roots are inside the unit circle, 
then (1) will not have any resonance as defined in (38). Hence, in 
general we will assume that all roots of (5) lie inside or on the unit circle. 

Hence, the resonance (3) will occur if and only if the frequency f is 
such that with 6(2) = arg p; either 


2rfr = 62) (modulo 27) or 2rfr = —O6(z) (modulo 27) (6) 


for some 7 = 1, ---, k with the property that |p:| = 1. That is, the 
detector (see Fig. 2) will give a “‘yes’’ response iff (6) is satisfied. As we 
are trying to detect the presence of the frequency f = fo, let us sup- 
pose by way of example that 6(1) = 2rfor (|p1| = 1). Then an input 
A sin (2rfot + v) would elicit a ‘‘yes’’ response from our receiver. (Any 
phase shift of A sin 27fo¢ will not affect the resonance of this signal, as 
A sin (2rfot + ¢) = (A cos ¢) sin 2rfot + (A sin ¢) cos 2rfot, and 
cos ¢ and sin ¢ never simultaneously vanish.) However, let us now 
suppose that also 6(2) = 2mrfir (|p2| = 1). Then the receiver would 
also detect an input frequency fi (and would not differentiate between 
fo and fi). Hence, one would know only whether or not ezther fo or fi 
is among the inputs. To positively identify the presence of fo, one 
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Fig. 2—Structure of a tone detector. 





must either insure that f; is out of band or use some other means to 
differentiate between fo and fi. 

Similarly, because of (6), the filter cannot distinguish between the 
frequency f and the frequency 7! — f, since 2r(7r7 — f)r = 27 
— 2nfr = —2xrfr (modulo 2z). In fact, 2rfr and —2zfr are the re- 
spective arguments of complex conjugates, and thus we see from (6) 
that no new resonances can occur if the characteristic polynomial (5) 
is altered to include among its roots any complex conjugates of pi, ---, 
px. We shall use this fact in our determination of a good structure for 
the recursion (4). When the filter is such that an input of frequency 
f will resonate, we shall say that the filter resonates (or has a reson- 
ance) at f. 

Recapitulating, because of (6), whenever the filter has a resonance 
at a frequency f, it will also necessarily and unavoidably resonate at 
the frequency 7! — f. To counter the effect of this in practice, 7 must 
be made sufficiently small so that 7~! — f is out of band. In keeping 
with (6), we refer to resonance at the frequency f as ‘‘resonance at the 
root e”"/7,” and resonance at 7-1 — f as “‘resonance at the conjugate 
root e~#7/7” [the roots in question being, of course, roots of (5) ]. 

The remaining resonances described by (6) are those due to aliasing. 
These also are intrinsic to the system—a consequence of using discrete 
(rather than continuous) input samples u,. Indeed, if resonance occurs 
at a frequency f (or, equivalently, at the root e”7/7), it will also occur 
at all the frequencies {f+ mr" for any integer m, as 2nfr 
= 2r(f + mr)r (modulo 27) or, equivalently, 


e®tit = exp[t2r(f + mr)r |. 


In practice, if conjugate resonances are out of band, resonances due to 
aliasing will also necessarily be out of band. 
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Hence, if pi, ---, pm are those roots of (5) of modulus 1, the filter will 
have resonances within the band [0, 77! ] at the frequencies @(1)/277, 
[2r — 0(1) ]/2a7, 0(2)/2a7, +--+, [2r — O(m) |/2a7. The number of 
distinct resonances in the interval [0, (27)! ] is m, less the number of 
roots among pi, ***, pm Which appear along with their conjugates. This 
picture is repeated in each successive interval [n7—, (n + 1)r71] 
(n = +1, +2, --:). 

It should be clear that, in choosing the recursion (1), one desires to 
have the number of resonances as small as possible—for the purpose 
of generation, to minimize the number of harmonics that can be pro- 
duced by perturbations of the initial conditions, and for the purpose of 
detection, to maximize the band in which the filter can detect a unique 
signal. Also, of course, one desires to have the memory k (a measure of 
the complexity of implementation) as small as possible. 

Ideally, one would like to have only one resonance, namely at the 
frequency one is trying to detect or generate. This is possible within 
the band [0, 771], by using the recursion +, = —%n-1 + Un. However, 
this resonates at a frequency equal to half the clock frequency 7~! and 
thus also resonates at the third harmonic (27)~! + 77 due to aliasing. 
As the third harmonic is frequently in band, this recursion is generally 
not satisfactory. 

On the other hand, for some complex number p of unit modulus, one 
could use the recursion %, = pUn_1 + Un which also has memory one. 
By adjusting 7, one could make the argument of p = exp (227for) 
small, thus avoiding any resonance up to as high a frequency as 
desired. However, there are problems with this recursion. First of all, 
the memory (in implementation) is not really one but two, as the real 
and imaginary parts of p must be handled separately. In fact, as seen 
before, no new resonances would be introduced by including the com- 
plex conjugate f of p to form a recursion of order two. Hence, one does 
just as well by replacing the characteristic equation \ — p = 0 with 
O = (A— p)(A — 6) = ® — ad + 1 (where the real number a = p 
+ p). The corresponding recursion replacing tn = p%n-1 + Un, also 
(but now explicitly) of memory two, 18 2 = G%n-1 — Lng + Un. This 
is the recursion after which digital linear filters are customarily 
modeled. However, as a (p) is, in general, not a rational number 
(gaussian rational*), it must in general be truncated, leading to slight 
frequency shifts, and multiplication round-off error in the feedback 
loop of these filters (Fig. 1); this could lead to unwanted limit cycles.” 
To avoid this, a (p) is restricted to be rational (gaussian rational). 
Even for rational numbers, however, truncation error would occur if 


* Has rational] real and imaginary parts. 
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the number of bits necessary to represent the number x, exceeded the 
word length allowed. In Section V we show that this can be controlled 
only if a is an integer. 

Hence, in the case of the real recursion, we restrict a to be an integer, 
and the only possibilities are a = 0, +1, +2. We have already ruled 
out a = —2 (this gives the square of the characteristic equation of 
Lnti = —Un + Un). If a = 2, this gives the square of the characteristic 
equation of @a41 = Un + Un, Which is even worse, as it produces 
resonance at the second harmonic. The remaining three possibilities 
for a correspond to cyclotomic polynomials of orders 3, 4, and 6 (as 
defined subsequently in this section). It will be shown that, by taking 
a cyclotomic polynomial for the characteristic equation (5), one 
always obtains the best possible recursion (1) for the given amount of 
memory. 

In general, to have perfect arithmetic (the only means by which to 
uniformly avoid unwanted limit cycles), it is necessary to constrain the 
feedback coefficients a;,2 = 1, ---, k [see (1) ] to be gaussian integers 
(see Section V). In fact, it will be shown that one can take each a; = 0, 
+1 so that each tap in the feedback loop involves at most changing 
the sign. Hence, from here on we restrict ourselves to three cases: the 
a,’S are gaussian integers, are integers, or are 0, +1. In what follows, 
we will show that the three are, for practical purposes, equivalent. 

For the first case, in the recursion corresponding to \ — p = 0 (no 
complex conjugate), the restriction to integer real and imaginary parts 
requires p = 1, +7 resulting in less generality than possible, as this 
corresponds to the recursions of the previous example with a = +2 
only. In fact, we can generalize this, and say it is always better to 
include among the roots of (5) all the complex conjugates, and thus to 
have a recursion (1), all of whose: coefficients are real (and hence 
integers). We will make this explicit in a moment, but let us first 
indicate the reasoning. First of all, by including the conjugates, no new 
resonances are introduced (as has already been demonstrated). Second, 
if among the roots of (5) even one conjugate were missing, the coeffi- 
cients of (1) would not all be real. In this case, the real and imaginary 
parts of x, would have to be considered separately, and one would thus 
need an effective memory of 2k. On the other hand, if one multiplies 
(5) by factors of the form (A — p), one for each root p of (5) whose 
complex conjugate is not also a root of (5), then the resulting poly- 
nomial and the corresponding recursion will have real coefficients. The 
respective degree and memory will thus be raised to no more than 2k 
(the effective memory of the complex recursion). Furthermore, as will 
be shown in Theorem 1 below, the new polynomial (and recursion) 
obtained from multiplication by the factors (A — #) will also be 
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guaranteed to have integer coefficients. Thus, we will do at least as 
well (and, as we have seen above, even better) by restricting all the 
recursions (1) to have real (and hence integer) coefficients. 

Let us now make this explicit. Suppose one has the recursion 


k 
tn = Dy ajLn—7 + Un, 
j=l 


where a;(7 = 1, -::, &) are gaussian integers: a; = a; + bj, (a; and b; 
integers, 7 = V—1). Let yn and Zn be, respectively, the real and im- 
aginary parts of x,. Then 


k 


Yr= dv (QjYn—j = b;2n-3) + Un, 


j=l 


k 
en = x (bjYn—j + Gj2n-j). 
= 


The only feature possibly mitigating in favor of the complex recursion 
is this: We are constrained to have a; and b; be integers. If the new 
recursion with added roots did not have integer coefficients, then in 
spite of the other considerations above, one would choose the complex 
recursion. However, in the following theorem we show this is not 
possible. 


Theorem 1: Suppose F(A) ts a polynomial with gaussian integer coeffi- 
cients, and suppose pi, --*, pm are those roots of F(A) whose complex con- 
jugates are not also roots of F. Then F(A) [][%1 (A — pi) has integer 
coefficients. Furthermore, if F(A) has no polynomial with integer coeffi- 
cients as a factor, then deg F = m. 


Proof: Write F(\) = g(A)hQ\), where h(\) = [JI (A — p.). Then g has 
real coefficients. Let p(A) be any irreducible factor of F(A) (considered 
as a polynomial over the gaussian integers). Suppose p has the root r 
in common with g and the root s in common with h. Then p (the 
polynomial in \ whose coefficients are the complex conjugates of the 
coefficients of p) has 7 as a root, and hence j must also be a factor of 
F, But § is also a root of p, whereas § is expressly not a root of F. 
Hence, any irreducible factor of F must be a factor of either g or h. It 
follows that g has integer coefficients, and h (and thus h) have gaussian 
integer coefficients. As h(A)h(A) has real, and hence integer, coefficients 
the theorem follows. 

Thus, it is best to take the coefficients of the recursion (1) to be 
integers. The theorem which follows completely characterizes those 
recursions. 
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First, however, a short description of cyclotomic polynomials must 
be given. The Euler ¢-function is a function on the positive integers, 
defined as follows: y(m) is the number of positive integers less than or 
equal to m and having no integer factor in common with m, other than 
1 (such integers are said to be relatively prime to m). For example, 
g(1) = 9(2) = 1, ¢(3) = o(4) = 2, (9) = 6. The cyclotomic (‘“cir- 
cle-dividing’’) polynomial of order m, denoted F,(\), is that monic 
polynomial (coefficient of the term of highest degree is 1) with integer 
coefficients all of whose roots are primitive mth roots of unity (that 
is, r™ = 1, and r® #1 for 0 <n < m). Over the integers, F'n(A) is 
irreducible (not a nontrivial product of polynomials with integer coeffi- 
cients).4 From the definition, one can explicitly determine that F(A) 
= [[a (\ — exp [227(d/m) ]), where the product is taken over all d, 
1 <d < _m such that d and m are relatively prime. Thus, the degree 
of Finis e(m). 

The next theorem shows that, whatever constraints there are on 
available memory and acceptable resonant harmonics, the characteris- 
tic polynomial of the optimal recursion will be a cyclotomic polynomial. 


Theorem 2: Let F(X) = \* — Soh-, aid*-*, where a, ¥ 0, ai (4 = 1, ---,k) 
are integers. Suppose every root p of F(A) = O satisfies |p| S 1. Then F 
7s a product of cyclotomic polynomials. 

This is proved in Section V. Recall from our prior discussion that all 
the roots of F must be chosen to satisfy |p| S 1 to have stable detec- 
tion. As it is, of course, better to have fewer resonances, one would 
hence choose for (4) a single cyclotomic polynomial. The cyclotomic 
polynomials make very desirable characteristic polynomials because of 
their extremely simple structure. For example, for m < 105 or for ma 
product of two primes, the coefficients of F,, are all 0, +1! For ma 
power of a single prime, the coefficients are all 0, 1 and for m < 385, 
the coefficients do not exceed 2 in absolute value. If m is a product of 
three distinct odd primes, all the coefficients are less than the smallest 
of those primes. These assertions are cited in Ref. 5. 

This means that implementation of the recursion (1) in the filter 
shown in Fig. 1 is very simple indeed. For all cases of practical interest, 
the feedback coefficients a; will be 0, +1. Of course, when a; = 0, one 
simply does not put a tap on the 7th stage. Because of the relation 


Pye ...p%(A) = Foyjepa(APr Pn”) 


(p; distinct primes—see Ref. 4), most of the coefficients of Ff, will 
usually be zero, and hence the taps-to-memory ratio is generally low 
(see Table I). 

In the preceding discussion, the principal emphasis has been on the 
use of the filter as a receiver. However, considerations relating to its 
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use as a generator lead to the same conclusion: that the characteristic 
polynomial (5) of the recursion (1) should be a cyclotomic polynomial. 
Indeed, for a generator, the problem of unwanted limit cycles is more 
critical. There is again the requirement that all the roots p; of (5) 
satisfy |p;| S 1, as small perturbations in the initial conditions 
Xo, °° *, tx-1 from the (ideal) values 0, sin 2rfo7, ---, sin 2rfo(k — 1)r 
(to generate sin 27fonr) are inevitable; if such a perturbation occurs 
along an eigenvector corresponding to a root p;, where |p;| > 1, it 
produces a nonzero coefficient 6; for that root in the general solution 
tn = Dba: bip? (where bi, ---, b, are functions of the initial conditions 
Lo, ***, Lp-1; See Section III). This component would attain an arbi- 
trarily large amplitude (with time) and overwhelm the desired tone. 

Hence, one again requires a filter that can perform perfect arithmetic 
and whose characteristic equation has all its roots on the unit disc. 
From Theorem 2 we thus deduce that (5) should be a product of cyclo- 
tomic polynomials for the generator as well. As tone generation is 
impeded by the presence of harmonic resonances at other roots (due, 
again, to perturbation of initial conditions), one takes for (5) a single 
cyclotomic polynomial. 

Thus we have shown that, for both generating and receiving, the 
best linear recursion is one whose characteristic polynomial is cyclo- 
tomic. As the roots in this case are all of the form exp [27i(d/m) ], the 
resonant frequencies can be expressed as 


ee ae (uoduloap (7) 


for all positive integers d < m such that d is relatively prime to m. 
Resonance at the fundamental is described by 27f7 = 2r(1/m), that 
is, the fundamental of the filter is f = r~!/m. Hence, if one requires a 
fundamental frequency of fo (i.e., if fo is the frequency of the tone to 
be generated or detected) and one intends to use a filter with memory 
k = gy(m), the clock rate 7~! is set at 77! = fom. All other resonances 
occur at various harmonics (multiples of fo) as follows: the resonant 
harmonics in the band 0 S$ f S 77 occur when fr = d/m, that is, at 
f = dfo for all those integers d as above. For example, if m = 30 then 
k = 8 and d assumes the values 1, 7, 11, 13, 17, 19, 23, 29. Hence, this 
filter has no resonances between the fundamental fy and the seventh 
harmonic. It resonates at the seventh harmonic 7 fo, and thereafter at 
11 fo, 13 fo, and so on. The resonances are at all the prime harmonics 
greater than 5, since in general those integers less than and relatively 
prime to the product m of the first » primes, are those primes lying 
between the pth prime and m. Furthermore, note that 30 = 1 + 29 
= 7+ 23 = 11+ 19 = 13+ 17. The first resonance due to aliasing 
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will always be at f = fot r= fo + fom = (m+ 1)fo. In the case 
of the previous example, this is the thirty-first harmonic. 

Factors pertinent to the choice of which cyclotomic polynomial to 
use are relegated to Section VI. Suffice it to say at this point that the 
more memory available, the farther away from the fundamental can 
the first resonance be made due to aliasing. However, except for the 
cases m = 1 and m = 2, the first resonance after the fundamental will 
be below the clock frequency 7~!. In these cases, for a given amount of 
memory k, if the interest is to have the first higher-order resonance as 
far from the fundamental as possible, one would find the largest integer 
r such that the product mm of the first r primes satisfies g(m) S k. Then 
the first higher-order resonance would occur at the qth harmonic, where 
q is the (r + 1)st prime. 


Hl. ELIMINATING IN-BAND HIGHER-ORDER RESONANCES 


The preceding analysis has indicated that, within the constraints 
established, various higher-order resonances are unavoidable. This 
could lead to difficulties. In practice, many higher-order harmonics are 
introduced in the process of limiting the input signal. The limiter (see 
Fig. 2) limits the amplitude of the input signal u(t). For example, a 
common limiter is a “hard-clipper.”’ This has output +1, depending 
upon whether u(t) = 0 or u(t) < 0. The effect of hard-clipping on an 
input is to produce all the odd harmonics: sin 27ft — 2/m sin 2rft 
+ 2/37 sin 6rft + 2/5z sin 107ft +---. Hence, a filter with more 
resonances frequently must be run for a longer period of time to attain 
a threshold sufficiently high to reject spurious signals. Also, when used 
as a generator, perturbations of the initial conditions of the filter could 
lead to unwanted harmonics at all the resonances of the filter. As such 
perturbations are inevitable, it is usually necessary to make allowance 
for eliminating these harmonics. 

While resonances due to aliasing are inherent to the discrete-time 
nature of the system and are hence unavoidable, resonances below the 
clock frequency 7! can be handled outside the feedback loop. In par- 
ticular, it is possible (in theory) to eliminate (in practice, to reduce the 
Fourier coefficients of) any or all resonances at a frequency f, 0 < f 
< (2r)7!, along with the conjugate resonance at 7! — f. This is 
effected through operations outside the feedback loop. Specifically, this 
is accomplished either through alteration of the input before it enters 
the filter: Un— vn = >02-1 ¢iUn_i, or equivalently through alteration 
of the filter output before it enters the threshold detector: 7, — Yn 
= 0721 Citn_:i (see Figs. 3 and 8). Although these two options are 
mathematically equivalent, considerations with respect to minimizing 
the word length necessary for perfect arithmetic would mitigate in 
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favor of one or the other. This will be discussed in Section V. Here, we 
will describe the latter option only. 
Let X (A) be the generating function for the sequence 


k 
Ln = DY, Ani + Un, 
1=] 


and let U(A) be the generating function for the input u,. That is, 


X= > tar", U(r) = = Und". (8) 
Then 
X(\) = 3 eNOyUO: -or OS 7, 
ae 1 — du a;\* 


Notice that defining F(A) = \* — > a;A*®*, the characteristic poly- 
nomial of the filter, we obtain 


X(a) = U(d). (9) 


1 
MF (A) 
Since F'(\) is assumed to be a cyclotomic polynomial, it is real and all 
its roots are of unit modulus. Hence p is a root if and only if 6 = p™ is 
a root. It follows that \*F(\—!) = F(A). Thus (9) may be rewritten as 


ao 


HO) = FQ) 


U(d). (10) 
We define a weighting function W(A) with the property that the 
resulting output function 


Y(\) = W()X() (11) 


has poles only at those roots of F(A) corresponding to those resonances 
actually desired. Specifically, W(A) will be a real polynomial of degree 
k — 2r, where r is the number of resonances desired in the band 
[0, (27)-]; the roots of W shall be those roots of F corresponding to 
the unwanted resonances. Typically, one desires to eliminate all 
resonances but the fundamental, in which case r = 1 and W(A)/FQ) 
= 1/(\? — ad + 1) for an appropriate real number a. Then, from (10) 
and (11), one obtains Y(A) = W(\A)X(A) = (1/Q? — ad + 1))U(Q) so 
Y(A) = —AY(A) + aAY(A) + UA), and 


Yn = AYn—1 — Yn—2 T Un. (12) 


This corresponds to a second-order filter with only one resonance in 
the band [0, (27)-! ] as shown in Fig. 3. Although there will be trunca- 
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Fig. 3—Implementation of the weighting function. 


tion error in (12), this will not lead to limit cycles, as there is no feed- 
back from this to the filter [although (12) represents the performance 
of the filter in terms of resonances, the filter, of course, is not realized 
in this way ]. Specifically, the weighting function is implemented as in 
Fig. 3. This is derived from definition (11): if W(A) = dofo cd’, 
then equating terms in (11) yields 


d 
Yn = Qo Cini (13) 
1=0 


where, typically, d = k — 2. 

As mentioned earlier, the arithmetic of the weighting function is only 
approximate; since there is truncation error in the computation of the 
coefficients c;, the roots of W will not precisely cancel out the roots of 
F. Rather, the roots of W will be slightly perturbed from the corre- 
sponding roots of Ff’. The effect of this, as will be shown, is that all the 
resonances due to the roots of F’ (1.e., all the resonant harmonics of the 
original feedback loop) will be present in the output y,—however, they 
will have reduced energy (but for the fundamental). That is, the less 
the error in the implementation of W, the smaller the Fourier coeffi- 
cients of the higher resonant harmonics of the filter. This 1s demon- 
strated below. 

Suppose F is the cyclotomic polynomial of order m (or any poly- 
nomial whose roots p:, --+, p, are distinct mth roots of unity, so that 
each p; = e”72/™ for some integer g, 0 S q < m). A continuous-time 
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extension x(t) of the discrete-time function x,, satisfying x(nr) = 2p 
can be defined as 


a(t) = > xnv(t — nr), (14) 


where v(t) describes a continuous-time extension of xn. Specifically, 
v(t) is a periodic input pulse satisfying v(é + mr) = v(t) for all ft 
[typically, v(t) = 1 for 0 St < 7]. In (4), set uz = v(nr) and nor- 
malize (0) = 1. Then 2, = 304-1 b;p5 for n << m. Let £(q) [d(q@) ] 
denote the gth Fourier coefficient of x(t) [v(t) ]. It follows that 


#(q) — [ao exp (—i2e 4 t) a 


MT 
m-—1 q 
= O(q) > Wn exp (—i2n £n) 
n=0 m 
. k m—l ; qd 
= 6(a) & bs", phexp (i244 n) 
j=l n=0 m 


where 7 is that index such that p; = exp [721(q/m) |; if no such index 
exists, then £(q) = 0. To simplify matters, we will use the expression 
“the Fourier coefficient at (the root) p,;’”’ to indicate what in the case of 
(15) is the gth Fourier coefficient £(q). 

These Fourier coefficients can be computed explicitly from (9). 
Indeed, factoring \*¥F (A!) = []%-1 (1 — p,A) obtains 





XQ) = 11; “a = U0) 


k 

= 2 Bi UM, (16) 
where the B,’s are the coefficients of the ihe fraction decomposition, 
derived explicitly in Lemma 3 below (it is assumed that all the roots 


p; are distinct; in the case of multiple roots, however, similar results 
obtain). From (16) one obtains 


k re) a) 
XQ) = DBS (oa Eur’ 
j= n= i= 
= 2 Bi LD pi ua’, (17) 
j 4,n 


SO tn = )0%=1 Bj Vefeo pj “ui [which is (4) above]. Hence, B; = b; 
(7 = 1, ---, &) and their explicit form is given in the following lemma. 
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Lemma 8: Suppose pi, +++, px are distinct numbers. Then 


htt (ho) 
i1l—prA iat (0: — 13) 1 — pid 
Jt 


Proof: The residue of the left-hand side at the zth pole is the coeffi- 
cient of that term in the sum above. The decomposition follows from 
the Cauchy residue theorem. 

Notice that, as the roots of F occur in conjugate pairs, a direct con- 
sequence of (17) is that, if p; and p; are conjugate roots, then the cor- 
responding Fourier coefficients are also conjugate: b; = by. 

The Fourier coefficients for the sequence y, can be determined as in 
(15). For tn = >> b;p5 as before, we obtain from (13) 





d k 
Yn = > cid bip'5 


z W (B;) 630°. (18) 


Thus, the Fourier coefficient of the sequence y, at the root p; is W (j;)b; 
(as could be expected, since Fourier transformations are multiplica- 
tive). Again, the conjugate coefficient W(p;) = W(p;). Observe that, 
if p; is aroot of W, then the Fourier coefficients of y, vanish at the roots 
p; and p; (W was chosen to be real). If W’ is the result of perturbing the 
coefficients of W to correspond to truncation error, then W’(f;) is (by 
continuity) close to zero. Hence, as errors in the weighting functions 
are reduced, so is the power at each of the resonant harmonics above 
the fundamental (running the system for finite time, of course). 
Surprisingly, W is very stable; if the coefficients of W’ are simply those 
of W rounded to the nearest integer (!), the results are frequently 
virtually as good as if W itself were used. This is exhibited in Table I 
and illustrated in Figs. 4, 5, and 6. These figures correspond to a filter 
using the cyclotomic polynomial F'3. The input is a hard-clipped sine 
wave for each given frequency up to 15 times the fundamental. The 
input frequencies are normalized to units of the fundamental frequency 
for each filter. For each input frequency, the filter is run for an amount 
of time equal to seven cycles of the fundamental. If this time corre- 
sponds to N steps of the filter, the output is maxn<y |2,|, as measured 
at each input frequency (1500 samples). Using a W’ with integer 
coefficients (or any W’ with uniformly truncated coefficients) enables 
one to perform all the multiplications as additions, simplifying im- 
plementation and eliminating any further errors. As one expects, upon 
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Fig. 4—Hard-clipped/no weighting. 
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Fig. 5—Hard-clipped/rounded weighting. 
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Fig. 6—Hard-clipped/exact weighting. 


setting p2 = fi, the Fourier coefficient of y, at the fundamental 


k k —_—— 
Wa) IT pt pA p1( pi) _ Pra 





f=2 Pl — Pj = Pi — P2j=3B Pi — Pj pi — po’ 
is the Fourier coefficient of (12) at the fundamental. 


lV. IMPULSE RESPONSE 


The impulse response is the output resulting from an input of a 
single pulse: Up = 1, Uaso = O. Since this output can also be produced 
by appropriately setting initial conditions, we will refer to it as a pulse 
train. From (4) we see that if the input u, is a single pulse, then the 
output z, reduces to 


Ln = > bip?. (19) 
In the context of the previous sections, it is assumed that the charac- 
teristic polynomial of the sequence z, is cyclotomic. Since each p; 1s 
then an mth root of unity, the sequence Xp iS periodi¢: tnym = Xn for 
all n. As before, the resonant harmonics present in the pulse trains 7, 
correspond to the mth roots of unity which are roots p: (¢ = 1, -:-, k) 
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of F = F,,; the Fourier coefficient of the pulse train at the root p; is 
b; (see Section ITT). 

In particular, using the notations of Section III, U(\) = 1 and thus 
(10) reduces to 


1 
X(\) = Fqy’ (20) 
But: AX (A) > po tak” = Or Pak”) (aan A). SINCE Lan — Tx: 
Defining f(\) = Om 2,d”, one obtains 
1—)\" 
Ff) = FO) (21) 


from (20). Notice that f has integer coefficients (the input wu, is integer, 
as are the coefficients a;). Indeed, 1 — A” is a product of cyclotomic 
polynomials, one of which is F(A). Specifically, 


Pe = & IT PaO) 


[the product is taken over all n which divide m; hence, for example, 


1 ~ r8 = —Fy(A)P2(A)F3(\) Fe(A) 
= (DA De dae DOF = A= DT; 


and, from (21), 
LO) = TT Fn) 


n-~m 


obtains. Consequently, f(e) = 0 for all mth roots of unity p, except 
for the primitive roots of unity [the roots of F(A) |. This was antici- 
pated by E. N. Gilbert in Ref. 6, where he showed that a pulse train 
x, of period m has resonances at those harmonics corresponding to the 
mth roots of unity which are not roots of (29 vad” = 0. Equation 
(21) covers the general situation where f(A) [and consequently F(A) | 
are arbitrary products of cyclotomic factors of 1 — \”. 

In the same paper, Gilbert was concerned about the problem of 
increasing the power of the pulse train at the fundamental (relative to 
the power at the other resonances). This could be done by shaping the 
input wu, for one period, but it is usually undesirable to do this. As 
explained in Section III, however, the same effect is obtained by 
utilizing a weighting function W. If utilized directly, this will introduce 
noninteger levels into the pulse train. Nonetheless, it is possible to 
avoid this by replacing W with W! where the latter is obtained through 
rounding off to the nearest integer the coefficients of the former. The 
pulse train resulting from W? will have integer levels, but the trunca- 
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tion error will again introduce higher-order resonances. However, 
Table I shows that these are very small indeed, leaving typically about 
98 percent of the power at the fundamental. This compares with 25 
percent or less (for Fic, Fos, 30) without W’. Note, for example, Fs. 
The pulse train 1, 0, 0, 0, —1, 0, 0, O has resonances at the third, fifth, 
and seventh harmonics. However, by simply altering this to 1, 1, 1, 0, 
—1, —1, —1, 0, the first appreciable resonance does not come until 
the seventh harmonic. In this case, use of W/ does not introduce any 
new levels in the pulse train. 

The worst case in Table I is f’5 where 92 percent of the power is at 
the fundamental. E. N. Gilbert has pointed out that if one wished to 
increase the proportion of the power at the fundamental of this train 
(or any other), one could multiply the output Y(A) by some constant 
c > 1, chosen so that the roundoff error of cW — (cW) is smaller 
than that for W! alone [recall (11) ]. This, however, would introduce 
more levels into the pulse train (although no more than c times as 
many). 

Table I gives an indication of the possibilities for various filters. 
Included are the filters with memory less than 12 which provide the 
greatest separation between the fundamental and the first resonant 
harmonic, either with or without the weighting function. The asterisks 
and daggers indicate those which, for the amount of memory, have the 
largest possible separation without or with the weighting function. For 
utilization with a “hard-clipper’’ (which has all odd harmonics), Fs, 
F,, and Fy5 are included. Although these resonate at all even harmonics, 
they have the same response to a hard-clipped input at the fundamental 
as the respective cyclotomic filters of twice the sampling rate. To have 
the first resonant harmonic higher than the seventh (without W) 
would require a memory of 48 (and F to have a coefficient of 2). The 
next interesting entry with respect to W is f'3. with memory 12. The 
columns to the right of the double line all deal with the integer-rounded 
transfer function W’. Columns A and B give |b:|2/> 4, |b:|? and 
|b; W? (p1) |2/D 72, |bsW7(p;) |2 as a percent, respectively, where 0; is 
the Fourier coefficient of the sequence x, at the root p:; [see (6) and 
Section III)]. Column C gives (maxo<;Sz/2 |bi;W*(f;) |2)/|b1W7 (A) |? as 
a percent. The roots p; (¢ = 1, ---, k/2) are assumed to be in order of 
ascending argument <7 (so p1 is the fundamental). Columns D and E 
give the moduli of the Fourier coefficients 6; and b;W‘(f;) of the 
sequences x, and yn, respectively. Columns F and G give the pulse 
trains of x, and yn, respectively, with initial pulse wo = 1, Unso = 0. 
The exponent denotes repeated digit; the arrow indicates that the 
preceding train is followed by another identical train, but that each 
digit is the negative of what it was. 
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Resonant Harmonics in the 
Band [0, 771], Aside From 


Table |— Characteristics of 


: Number of 
Characteristic Pundamente! Firat Taps on Filter || nteger-Rounded 
Mem- Polynomial Resonant (Without Weighting 
ory F Harmonic Due Weighting Function 
to Aliasing Function) wt 
Without With 
Weighting Weighting 
Function Function 
*] Fe=rA+1 none — 3 1 — 
2 | Fs=d2+A+1 2 _— 4 2 — 
2 | Fa=d?+1 3 — 5 1 — 
*2 Fe=d2—d+1 5 —_ 7 2 —_— 
4 | Fg=d4+1 of Oe 7 9 sf 1+r+22 
T4 | Fir=MéM—N+1 5, 7, 11 11 13 2 142+ 2? 
6 ) Fo=dA8+h3+41 2,4, 5, 7,8 8 10 2 ihe ete 
Mé 
T6 | Fis=vAS—AB-+ 1 5, 7, 11, 13, 17 17 19 2 eee 
ri 
8 Fis=dA8—AT-+A5 | 2, 4, 7, 8, 11, 14 16 6 L4+A+A2-+A43-4-0 
ia 13, 14 +A5-+A8 
8 | Fig=A8+-1 3, 0) 1, 9, 11; 15 17 14+ 22+ 224-323 
13, 1 +2r44-2r5-+A5 
8 | Fa=A8—Mé+1 | 5,7, 11, 13, 17, 23 25 14201324323 
19, 23 + 3r4-42r5-+-A6 
T*8 | Fao=A8+-A7—AS | 7, 11, 18, 17, 29 31 6 1+3A+5d2+5x3 
a 19, 23, 29 + 55+ 35+ A8 


*f See text for explanation 


V. CONDITIONS FOR PERFECT ARITHMETIC 


Here we indicate why cyclotomic polynomials yield optimal recur- 
sions for generating sinuosidal signals. When we use (1) to generate 


tones, the wn is set to zero and some initial condition wo, 11, - ++, 2-118 
chosen to generate the required samples «,: 
k 
Lyn = oe QAitn—i- (22) 


t=] 
If we use the usual second-order recursion, then (22) is of the form 


Ln = AX n—1 eae tn—-2; 


(23) 


where |a| < 2, so we have complex roots. In this case, we show below 
that the number of distinct values that xn, n = 0,1, --:, N can take 
grows at least as fast as N/2, with N. So, to simulate (22) with perfect 
arithmetic, the number of ‘‘words’”’ needed grows at least as fast as N, 
the number of samples needed. 


Proposition 4: Suppose |a| < 2, and rational but not an integer. Then 
for any initial conditions xo, x1 (not both zero) and any positive integer N, 
the number of distinct values among “Xo, -, &y, Where Xn = AXn_-1 
— X4n-2, for2 Sn SQN, is at least N/2. 
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some cyclotomic filters 








A B D E F G 
% of Total Highest Power Atodulus-of Mourior 
(0, Gort oh pie eae An SG of Pulse Trains 
Fundamental % of bi 
Fundamental) 
nae pa a Yn = a 
100 am —_ 1 —_ 1, -l — 
100 — —_ 0.58 — 1, -1,0 — 
100 — — 0.5 — 1,0, —1, 0 — 
100 —_— —- 173 — 1270 —120 — 
50 7.1 2.9 All 0.25 0.60, 0.10 103 — 103 130 — 180 
50 99.5 0.5 All 0.29 1.08, 0.08 10103 — 10 — 103 12310 —1—23—10 
33.0 92.7 7.8 All 0.19 here ee 102— 105 1212—12—2—10 
33.3 99.6 0.3 All 0.19 7.6, 0.04, 102105—> 1234210 > 
53.3 98.9 0.8 0.33, 0.27, 4.78, 0.51, 1302— 1307 123321—1—2 
0.09, 0.11 0.55, 0.75 —33—2—10 
25 98.0 1.8 All 0.13 aie Nae 107—107 12232210 > 
.06, O. 
25 99.5 0.3 All 0.14 sae anee 103107—103—107 | 12324332210— 
.09, O. 
6 98.4 1.0 0.11, 0.09, 2.41, 0.04, 1—11021—1107— | 123254524532210— 
0.27, 0.33 0.19, 0.24 


Proof: We can write tn = bip{ + bep3, where pi, po are the distinct 
roots of #2 — a’ + 1, as in (19). Since the roots are not real, let 
p = pi(= po), b = b1(= be). Then xn = Xmimplies Re (bp”) = Re (bp”). 
In this case, letting 6 = arg p, » = arg b, we obtain cos (¢ + 78) 
= cos (g + m6) so ¢ + n6 = +(¢ + mé) (mod 27). Since p is not a 
root of unity, the numbers né (n = 0, 1, 2, ---) are all distinct and 
hence for fixed m either n = m or n6 = —2¢ — mé@ (mod 27). As this 
last congruence can be satisfied by at most one n, it follows that, for 
each m, there is at most one n # m such that t, = In. 

The following result shows that, if one wishes to generate sin 7n@ 
with perfect accuracy using a linear recursion, e’7? must be a root of 
the corresponding polynomial (5). 


Proposition 5: If 8s, = sin wnO ts a solution of tn = >) A;Xn_; and 6 is 
not an integer, then e*™® ts a root of the polynomial X* — >) ad*~?." 


Proof: From sin r(n + 1)@ = Sia; sin r(n +1 — 7)6, we expand 
both sides using a familiar trigonometric identity and get 


sin 7n@ cos 70 -++ cos 7né sin 76 = sin r(n + 1)8 
= >a; sin r(n + 1 — 7)@ = >) a; sin r(n — 7)6 Cos 78 
+ >° a; cos r(n — 7)6 sin 76 = sin 776 cos 78 
+ >> a; cos r(n — 7)6 sin 7. 


GENERATOR-DETECTORS 489 


Since @ is not an integer, sin 7@ ~ 0, and thus from the equality of the 
first and last expressions, we obtain cos 7n@ = > a; cos r(n — 7)8. 
Hence, cos 776 is also a solution to the recursion, and it follows that 
e'™§ = cos mn? +7sin rnd is a solution too. Consequently, e*™*? 
— > ajet-9 = 0, 

The next theorem shows that every recursion which satisfies the 
stability criterion |p| <1 for all its roots, and for which perfect 
arithmetic is possible, is cyclotomic. 


Theorem 6: Suppose every root p of the polynomial F(A) = * 
— Piha; ai\*—* satisfies |p| S 1. 


(1) If ay, +++, ay are integers and a, ~¥ 0, then F(d) ts a product of 
cyclotomic polynomials. 

(21) If ai, +--+, a, are rational numbers and tn = >, AiXn-i ts periodic 
(Unt-p = Ln for some p, all n) for some nonzero initial conditions 
Xo, ***, Ux-1, then F(d) has as a factor a cyclotomic polynomial. 


Proof: For case (2), each irreducible factor (over the integers) of F(A) 
has the same form as F(A) itself by‘ ‘Gauss’ Lemma’’.® Thus, it 
suffices to assume that F(A) is irreducible, in which case all its roots are 
distinct. In this case, we can write x, = )> bip? where the p,’s are the 
roots of F(A) and x, is as in case (77). But then |z,| S > |b;|, and as 
for any integer initial conditions xo, --+, Xz—-1, Xn Will be an integer for 
all n, 2, can in such a case assume only a finite number m of distinct 
values (m = [>> |);| ]). Hence for all n, the ktuple (tn41, +++, Un+x) 
can assume at most m* distinct values, and as x, is recursively gen- 
erated with memory k, x, must be periodic, of period p S m*. This 
brings us to case (72). 

For case (72), let L be the rational canonical form associated with 
the recursion 2, (see Ref. 7, Section 5.2.1), and J be the Jordan 
canonical form of LZ. Then for some initial state vector x, J?’x = x, and 
it follows that some diagonal element of J, that is, some root of F(A), 
must be a pth root of unity. Hence, the irreducible factor of F(A) 
having that root must be cyclotomic. 

Hence, from the above the @ of Proposition 5 must be rational when 
perfect accuracy is required. 

In all the preceding, the basic assumption has been that all the 
coefficients of the recursion (22) are real. We can infer from Theorem 1 
that this is no loss of generality as, if the recursion had complex coeffi- 
cients (with rational real and imaginary parts) and was irreducible 
over the field Q(z) (the field of gaussian rationals), then the roots of 
the characteristic polynomial would be distinct, no pair being con- 
jugate. Indeed, Theorem 1 remains true if the word “‘integer”’ is every- 
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where replaced by “rational number.”’ The arguments of Section II 
show that we may as well assume all the coefficients are real. 


Vi. COMPUTING WORD LENGTH AND ADDITIONS PER CYCLE 


To realize the cyclotomic filters in hardware with perfect arithmetic, 
the necessary amount of memory and adder complexity must be pro- 
vided. We describe here how to estimate the word length and the rate 
of additions required to implement a cyclotomic filter with a weighting 
function. It shall be assumed that all operations are performed in 
binary form. The number of binary bits required to store each x, is 
called the word length w of the system. For generators that produce a 
signal approximating a sinusoid, the word length required will depend 
on the accuracy of approximation needed. When the filter 1s used as a 
tone detector, the word length required will depend on the duration of 
operation, since the signal level tends to build up, especially at fre- 
quencies close to any resonant frequency (Fig. 7). The signal level, of 
course, does not uniquely specify the minimum word length. Even 
though for storing 7, we may need only w bits, it is conceivable that 
during the computations numbers greater in magnitude than x», which 
need more bits for storage, could arise. To perform operations in a 
serial-multiplexed fashion, it is desirable to have uniform word length 
for all operations in the feedback loop of the filter. Hence, the word 
length will have to be increased to accommodate any number en- 
countered during the computations. However, for the filters considered 
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Fig. 7—Growth of output. 
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in Table II, it is possible to arrange the computations in such a way 
that the word length is determined by the maximum magnitude of &n. 
In general, there are a finite number of ways in which the additions 
involved in the filter can be arranged. By simulation of the different 
arrangements, the word length required can then be determined. 

There are two possible ways of implementing the cyclotomic filters 
as generators. The first is to generate the impulse response (19); this 
is generally sufficient (see Table I). In this case, the weighting function 
(18) shapes the effect of this impulse to simulate the initial conditions 
Lo, °**, Le-1 Of the tone being generated. As the input is zero after the 
initial pulse wo = 1, the weighting function need only be used during 
the first d + 1 steps of the filter. Let m be the largest number in the 
pulse train yn of Table I, and let [[«]] be the smallest integer larger 
than x. The word length necessary for perfect arithmetic is at least 
w = [[loge m]]+ 1 and, for the filters considered here, w is also 
sufficient. (We add 1 for a sign bit.) This word length is shown in 
column B of Table II. 

However, rounding off in the weighting function introduces errors 
in the effective initial values of the signal. If this approximation is not 
sufficiently good, then the initial conditions of the filter xo, ---, Y-1 
can be set as accurately as needed, and then the filter is operated with 
the feedback loop alone. In particular, one can set the initial conditions 
of the filter such that |v, — sin 2an/p| < 2-" (n = 0, ---, k — 1) 
where sin 27n/p is the desired signal. One can then compute the mini- 
mum word length required by simulating the filter for one period. In 
all cases of interest here, the word length including sign is (m + 1) 
for m S 12. Hence, as an example, the cyclotomic filter of order 30 
can generate a sequence (2,) such that |x, — sin 2rn/p| < 27" if 
the initial conditions are set such that |v, — sin 2rn/p|< 271 
(n = 0, ---, 7), using a word length of 11. 

To determine the number of binary additions per period of the filter 
(i.e., per cycle of the fundamental), one counts the number of bit 
additions per step. If m denotes the number of additions per step, then 
pmw is the number of binary additions per cycle, where p is the period 
of (22) and w the word length used in the feedback loop (see above). 
When the generator is implemented in the first way (using an initial 
pulse and the weighting function), the number of additions is shown 
in column C of Table II (mot including those necessary in the initial 
d+ 1 steps for the weighting function). When the generator is im- 
plemented in the second way (setting the initial conditions), the num- 
ber of additions can be computed by multiplying the value in column C 
by w/w’, where w is the word length chosen and w’ is the corresponding 
word length from column B. 
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When the filter is used as a detector, we assume that the input to the 
filter is a sequence which only assumes the values +1 and —1. This is 
true, for example, when the analog signal to be detected is either hard- 
clipped or delta-modulated. In these cases, it is advantageous to apply 
the weight function to the input sequence u, rather than to the se- 
quence x,,; since, in general, x, can assume many values other than +1 
and —1, computations involving the weighting function are simplified 
if they are performed on the input (see Section III). In fact, applying 
the weighting function to the input is so simple arithmetically that it 
can be implemented with read-only memory. On the other hand, if 
read-only memory is not used and one wishes to save on computations 
by checking the threshold (max {z,}) only in the last cycle of the filter 
(with respect to its duration of operation for detection), then the 
weighting function is best implemented as in Section III, on the output 
of the feedback loop. Then the filter can be run during all but the last 
cycle, without computing the weighting function. 

When the weighting function is applied to the input, the filter is 
described by 


d 

Un = > CiUn~i (24) 
i=0 
k 

tn = D2) Ain i t Vn, (25) 


wl 


where wu, 1s the input into the filter and v, is the result of the weighting 
function. Figure 8 describes this filter. 

For the filters in Table I, the effect of rounding c; to the nearest 
integer is slight. Hence, it is a fortiori suitable to round off 
Un = >> Citn_i to the nearest integer. Therefore, since the only values 


Xn—1 Xn—-2 ee Xn-—k 
a2 a, 

Xn 
Cy Cy 


Fig. 8—Implementation of the weighting function at the input. 
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assumed by u; are +1, it suffices to have for v,z a word length of 
w = [[loge {> |c:|}]] + 1 (where {2} is the integer closest to x and 
[[x]] is the smallest integer larger than x; 1 is added for a sign bit). 
The sequence v, can then assume any value between — {>> |c,;|} and 
{>> |e;|}. With d as in (24) and w as above, implementations of the 
weighting function with read-only memory then requires 24+! w memory 
bits. The respective values for this are shown in column D of Table II. 
When a bank of such tuned filters is used in one receiver (for example, 
in a Touch-Tone® system such as described in Ref. 3), all the filters 
could use one read-only memory for the weighting functions. Also, by 
increasing w, we can make the round-off error as small as we wish. 

To determine the word length for use in the feedback loop of the 
detector, the maximum signal level can be determined by using an 
input u, of the same frequency as the resonant frequency. Since the 
impulse response [see (19) ] of these filters is periodic and of the same 
period as the resonant frequency, the latter produces the maximum 
signal level supnswy Xn, for duration of operation Nr. Let this maximum 
be M. The word length required should then be at least [[log. M]]+ 1. 
For all the filters considered here, [[loge M]]-+ 1 is also sufficient. 
The number of M, of course, is determined by N. If the cyclotomic 
filter is of period p (i.e., Theorem 1 is F,), then the filter runs through 
N/p periods, corresponding to N//p cycles of the fundamental. Calcula- 
tions have been made for two values of N/p: 7 (the number of cycles 
computed in Ref. 3 to be necessary for Touch-Tone interchannel rejec- 
tion), and 10 (a more uniform point of reference). 

In Table II, column E shows the word length required in the feed- 
back loop for the indicated durations, when the weighting function is 
computed on the input as in (24), implemented equivalently with or 
without read-only memory, producing the filter response (25). 

When there is no weighting function on the input, the word length 
required is shown in column F (of course, a weighting function may be 
applied to the output as in Section III). 

The number of binary additions per cycle for the detector is de- 
termined in the same way as for the generator; the number is pmw as 
defined above. These numbers are shown in columns G, H, and K of 
Table II. Column G shows the number of binary additions per cycle 
in the feedback loop when read-only memory is used to implement the 
weighting function, applied to the input as in (24). If read-only memory 
is not used, then the weighting function has to be computed. Since the 
numbers involved in the computation of the weighting function [when 
implemented as in (24) ] are generally smaller than those in the feed- 
back loop, the word length required for their computations are smaller. 
Hence, one can use two different adders, one for the weighting function 
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Table Il— Complexity of some cyclotomic generator-detectors 





Detector: 7 Cycles Detector: 10 Cycles 
Generator 
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ae ae) ae} ae} 
3 («|S 3 £ yz [|= = 
~~ <a foe = 2 e = = S 2 e = e < 
Cl Ph (G8) S |wS)] Ss] ws 3 ~ |S} es | es eS oe 
RF |} of 138] © Sa) 68a) 38 g 2 i oa2/ 6a] 38 am & 
ay eat. | Bee pees) eS) 8 con se = ee el fe 
A B C D E F G H K E F G K 
6 2 24 — 6 6 72 72 — 7 7 84 84 — 
8 2 16 24 v4 5 56 40 112 8 6 64 48 128 
9 3 54 | 128 8 5 144 90 360 8 6 144 108 360 
12 3 72 24 8 6 192 144 288 9 7 216 168 324 
15 3 270 | 512 9 7 810 630 810 10 7 900 630 900 
16 3 48 | 640 9 5 144 80 1276 10 6 160 96 1440 
18 3 108 |; 128 9 6 324 216 1134 10 7 360 252 1260 
24 4 192 | 640 10 6 480 288 2160 11 7 528 336 2376 
30 4 720 | 768 11 8 1980 1440 3630 11 8 1980 1440 3630 


and one for the feedback loop. Using this arrangement, the number of 
additions per cycle for calculating the weighting function is shown in 
column K. The number of binary additions per cycle when no weighting 
function is used is shown in column H. This, of course, applies when 
the weighting function is applied to the output as in Section III (but 
does not include the number of additions necessary for the weighting 
function). To calculate the number of additions when the weighting 
function is applied to the input, but read-only memory is not used, add 
columns H and K. 

Column A indicates the respective cyclotomic filters described by 
their periods. 

One important consideration that affects the choice of the order of 
cyclotomic filter is the noise level at the input to limiter (together with 
the noise in the limiter). This affects the output of the limiter when the 
signal level is low. One could divide the period of the signal to be 
detected into regions where errors could affect the decision about the 
sign of the signal, and regions where no errors will occur. Those sam- 
pling instances where errors could occur lie in regions where the absolute 
value of the signal is small. Suppose these regions are intervals of 
length e€ around the zero crossings of the signal. The worst case cor- 
responds to a phase shift of the signal with respect to the sampling 
interval which maximizes the number of samples in the error regions. 
For e = 1/63 (corresponding to approximately 20 dB s/n), there are 
at most two samples per period that are subject to errors for all the 
filters we have considered here. Hence the ratio of error-susceptible 
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samples to error-free ones decreases in this case as the period p in- 
creases (for p S 30). This ratio indicates the perturbation of the thresh- 
old one has to make in order to compensate for errors in the limiter. 


Vil. APPLICATIONS 


Possible uses for the systems described in this paper have been 
mentioned in Section J. In particular, a scheme is proposed in Ref. 3 
for utilizing eight cyclotomic filters as channel detectors in a Touch- 
Tone receiver. 

Another application of cyclotomic filters may be rsx. As described 
earlier, by selecting the initial conditions of a cyclotomic filter of 
period p, one can approximate uniformly sampled values of a sinusoid 
of period p, i.e., sin 2rn/p. By changing the clock rate of the filter, one 
can shift the frequency of the sinusoid to any preassigned value. 
Hence, when using the filter as a generator, one can shift the clock rate 
to shift the frequency. This method of shifting frequencies does not 
introduce any “discontinuities” in the signal. If, instead of changing 
clock rate, one were to change the coefficient of a filter, then the filter 
has to be reinitialized to have constant amplitude, thus producing a 
discontinuity in the signal. In a similar manner, when using the filter 
as a detector, one can shift the resonant frequency by shifting clock 
rate. Hence, with the same filter, one can generate and detect both 
tones used in a typical Fsk arrangement. Furthermore, cyclotomic 
filters have infinite Q, allowing for the possibility of increasing signaling 
rate above the presently used systems with finite Q. 


REFERENCES 


1. L. B. Jackson, ‘An Analysis of Limit Cycles due to Multiplication Roundoff in 
Recursive Digital Filters,’’ Proceedings of the Seventh Allerton Conference on 
Circuits and Systems Theory, 1969, pp. 69-78. 

. H. Breece, private communication. 

. B. Gopinath and R. P. Kurshan, “A Touch-Tone® Receiver-Generator with 
Digital Channel Filters,” B.S.T.J., this issue, pp. 455-467. 

. 8. Lang, Algebra, New York: Addison-Wesley, 1965. 

. E. Lehmer, “On the Magnitude of the Coefficients of the Cyclotomic Polynomial,”’ 
Bull. Am. Math. Soc., 42 (June 1936), p. 389. 

6. E. N. Gilbert, ‘Pulse Trains Which Lack Prescribed Harmonics,’”’ unpublished 
document. 

. B. Gopinath and R. P. Kurshan, “Recursively Generated Periodic Sequences,”’ 
Canadian Journal of Math., XX VJ, No. 6, 1974, pp. 13856-1371. 


Ce ND 


“J 


496 THE BELL SYSTEM TECHNICAL JOURNAL, APRIL 1976 


Contributors to This Issue 


William M. Boyce, B.A., 1959, and M.S., 1960, Florida State Uni- 
versity; Ph.D., 1967, Tulane University; U. 8. Army, 1963-65; 
NASA Manned Spacecraft Center, 1963 and 1965-67; Bell Lab- 
oratories, 1967—. At NASA, Mr. Boyce was head of a section work- 
ing on navigation plans for the Apollo missions. At Bell Laboratories, 
he has worked on business data processing, financial modeling, eco- 
nomic theory, computational graph theory, and other topics in applied 
probability and management science. Since 1970, he has been head of 
the Mathematics Analysis Department. Member, IEEE, SIAM, 
ORSA, American Finance Association. 


Ronald E. Crochiere, B.S., (E.E.) 1967, Milwaukee School of 
Engineering; M.S. (E.E.) and Ph.D. (E.E.), 1968 and 1974, Mas- 
sachusetts Institute of Technology; Bell Laboratories, 1974—. Mr. 
Crochiere is presently engaged in research activities In speech communti- 
cations and digital signal processing. Member, IEEE, Sigma Xi, IEEE 
Acoustics, Speech, and Signal Processing Group Ad Com; Associate 
Editor, IEEE ‘Transactions on Acoustics, Speech, and Signal 
Processing. 


David D. Falconer, B.A.Sc., 1962, University of Toronto; 8.M., 
1963, and Ph.D., 1967, Massachusetts Institute of Technology; 
post-doctoral research, Royal Institute of Technology, Stockholm, 
1966-67; Bell Laboratories, 1967—. Mr. Falconer has worked on 
problems in coding theory, communication theory, channel charac- 
terization, and high-speed data communication. Member, Tau Beta 
Pi, Sigma Xi, IEEE. 


B. Gopinath, M.Sc. (Mathematics), 1964, University of Bombay; 
Ph.D. (E.E.), 1968, Stanford University ; Research Associate, Stanford 
University, 1967-1968 ; Alexander von Humbolt Research Fellow, Uni- 
versity of Géttingen, 1971-1972; Bell Laboratories, 1968—. Mr. 
Gopinath is engaged in applied mathematics research in the Mathe- 
matics and Statistics Research Center. 


Robert P. Kurshan, Ph.D. (Mathematics), 1968, University of 
Washington; Krantzberg Chair for Visiting Scientists, Technion, 
Haifa, Isarel, March-August 1976; Bell Laboratories, 1968—. Mr. 


497 


Kurshan is engaged in mathematics research, with an emphasis on 
algebra, in the Mathematics and Statistics Research Center. President, 
MAA-NJ, 1975—. 


Vasant K. Prabhu, B.E. (Dist.), 1962, Indian Institute of Science, 
Bangalore, India; 8.M., 1963, Sc.D., 1966, Massachusetts Institute 
of Technology; Bell Laboratories, 1966—. Mr. Prabhu has been con- 
cerned with various theoretical problems in solid-state microwave 
devices and digital and optical communication systems. Member, 
IEEE, Eta Kappa Nu, Sigma Xi, Tau Beta Pi, and Commission 6 of 
URSI. 


Lawrence R. Rabiner, 8.B., S.M., 1964, Ph.D., 1967, Massachusetts 
Institute of Technology; Bell Laboratories, 1962—. Mr. Rabiner has 
worked on digital circuitry, military communications problems, and 
problems in binaural hearing. Presently, he is engaged in research on 
speech communications and digital signal processing techniques. 
Coauthor, Theory and Application of Digital Signal Processing. Mem- 
ber, Eta Kappa Nu, Sigma Xi, Tau Beta Pi; Fellow, Acoustical 
Society of America; former President, IEEE G-ASSP Ad Com; 
member, G-ASSP Technical Committee on Digital Signal Processing, 
G-ASSP Technical Committee on Speech Communication, IEEE Pro- 
ceedings Editorial Board, Technical Committee on Speech Communi- 
cation of the Acoustical Society; former Associate Editor of the 
G-ASSP Transactions. 


498 THE BELL SYSTEM TECHNICAL JOURNAL, APRIL 1976 


Abstracts of Bell System Papers 
Appearing in Other Publications 


Beginning with this issue, the Journal will publish abstracts of papers 
written by Bell System authors for other technical and scientific publi- 
cations. We hope this new section provides you, our readers, with a 
reference source for articles covering the broad range of research and 
development in the Bell System. 


CHEMISTRY 


Heterogeneous Removal of Free Radicals by Aerosols in the Urban Troposphere. 
L. A. Farrow, T. E. Graedel, and T. A. Weber, ACS Symposium Series, Removal of 
Trace Contaminants from the Air, ed. Victor R. Deitz, 17, 1975, pp. 17-27. The 
effect of aerosols on atmospheric photochemistry has been evaluated in a computation 
of the gas phase chemistry of the urban troposphere for the northern New Jersey 
metropolitan region. It is shown that aerosol-radical interactions provide an efficient 
radical sink and stabilize the diurnal variation of radical concentrations. 


The Influence of Aerosols on the Chemistry of the Troposphere. T. E. Graedel, L. A. 
Farrow, and T. A. Weber, I. J. Chem. Kinetics, Symposium No. 1, 1975; Proceed- 
ings of the Symposium on Chemical Kinetics Data for the Upper and Lower Atmo- 
sphere, pp. 581-594. Full kinetic calculations of the diurnal chemistry of the 
urban troposphere have been made using a formalism that includes the interactive 
effects of aerosols and free radicals. These effects are shown to be necessary to a 
unified analysis of atmospheric chemical reactions. 


Liquidus-Solidus Isotherms in the In-Ga-As System. M. A. Pollack, R. E. Nahory, 
L. V. Deas, and D. R. Wonsidler, J. Electrochem. Soc., 122 (November 1975), pp. 
1550-1552. Liquidus and solidus data are presented for the 800°, 850°, and 900°C 
isotherms in the In-rich corner of the In-Ga-As phase diagram. A simple solution 
model gives excellent agreement with the solidus data, but describes the liquidus 
more poorly than desired. 


Ozone: Involvement in Atmospheric Chemistry and Meteorology. T. E. Graedel 
and L. A. Farrow, Ozone Chemistry and Technology, ed. J. S. Murphy and J. R. Orr, 
Philadelphia: Franklin Institute Press, 1975, pp. 165-175. The chemistry of ozone 
is Closely related to virtually every gas phase chemical process that occurs in the 
troposphere and stratosphere of the earth. This paper reviews the current knowledge 
of ozone sources and sinks for the urban troposphere, the rural troposphere, the natural 
stratosphere, and the perturbed stratosphere. 


The Synthesis and Characterization of Some Oxide Fluorides of Rhenium and 
Osmium. W. A. Sunder and F. A. Stevie, J. Fluorine Chem., 6 (November 1975), 
p. 449. Iixisting synthetic methods for oxide fluorides of rhenium and osmium 
have been reviewed. New syntheses, using static heating, have been developed for 
OsO3F 2, OsOoF3, OSOF;, OsOF,, ReO3F, ReOoF3, ReOF;, and ReOF,. The products 
were characterized principally by mass spectroscopy, with supporting information 
for X-ray powder diffraction, chemical analysis, and molecular beam deflection. 


ELECTRICAL AND ELECTRONIC ENGINEERING 


Using Discretionary Telecommunications. D. Gillette, IEEE Trans. Commun., 
COM-23 (October 1975), pp. 1054-1058. Continuing technical effort can help 
reduce the cost of telecommunications and add opportunities for their use. However, 
the biggest task in application is organizing institutions and procedures to use exist- 
ing telecommunications systems and information technologies effectively. 
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MATERIALS SCIENCE 


Lead Alloys for High Temperature Soldering of Magnet Wire. W. G. Bader, Welding 
Journal, 64 (October 1975), Research Supplement, pp. 370-s to 375-s. Lead-tin 
solders were evaluated for use in high-temperature soldering of fine gauge, poly- 
urethane-insulated, copper-magnetic wire. The dissolution rates of copper by molten 
solders were determined at temperatures to 900°F and the reduction of these rates by 
copper additions to the solder. Also, wetting of copper by the solders and solder 
joint appearance were evaluated. 


GENERAL MATHEMATICS AND STATISTICS 


Explicit Construction of Invariant Measures for a Class of Continuous State Markov 
Processes. 8S. Halfin, Ann. Prob., 3 (October 1975), pp. 859-864. An explicit 
construction of invariant measures for a certain class of continuous-state Markov 
processes is presented. A special version of these processes is of interest in the theory 
of representation of real numbers (8-expansions). Previous results of Rényi and Parry 
are generalized, and an open proklem of Parry is resolved. 


Ridge Analysis Following a Preliminary Test of the Shrunken Hypothesis. R. L. 
Obenchain, Technometrics, 17 (November 1975), pp. 431-441 (with discussion by 
G. C. McDonald, pp. 448-445). Ridge analysis is a ‘‘new’’ form of multiple linear 
regression which can be helpful when the data are ill-conditioned (nearly multi- 
collinear) and least-squares coefficients are highly intercorrelated. Utilizing the 
likelihood function for mean-squared-error optimality under normal distribution, a 
statistical test can detect situations where ridge analysis will be worthwhile. 


PHYSICS 


Aspects of the Band Structure of CuGaS. and CuGaSe>o. B. Tell and P. M. Briden- 
baugh, Phys. Rev. B, 12 (October 15, 1975), pp. 33830-3335. The spin-orbit 
splitting has been determined in the sulfur-rich section of the system CuGaSes_o,Seez, 
which demonstrates that the spin-orbit splitting is negative in CuGaS.. A model which 
provides adjustable coupling and separation between the p- and d-like valence band 
can account for the main features of the band structure of CuGaS2 and CuGaSe>. 


Excitation of Transversely Excited CO. Waveguide Lasers. O. R. Wood II, P. W. 
Smith, C. R. Adams, and P. J. Maloney, Appl. Phys. Letters, 27 (November 15, 
1975), pp. 539-541. Using a preionization scheme based on the Malter effect, 
small-signal gains >5%/cm at 10.6 wm have been produced in a 1-mm? cross-section 
waveguide COs: amplifier at total operating pressures of 0.1 to 1 atmosphere. Com- 
parisons between this preionization scheme and those using electron beams are made. 


Dynamic Spectroscopy and Subpicosecond Pulse Compression. E. P. Ippen and C. 
V. Shank, Appl. Phys. Letters, 27 (November 1, 1975), pp. 488-490. Picosecond 
pulses from a mode-locked cw dye laser have been compressed in time to produce 
pulses as short as a few tenths of a picosecond. Dynamic spectroscopic investigations 
of the laser pulses reveal temporal asymmetry and frequency chirping on a sub- 
picosecond time scale. 


Frequency Dependence of the Electron Conductivity in the Silicon Inversion Layer 
in the Metallic and Localized Regimes. S. J. Allen, Jr., D. C. Tsui, and F. DeRosa, 
Phys. Rev. Letters, 35 (November 17, 1975), pp. 1359-1362. The conductivity of 
electrons in the inversion layer of silicon has been measured from 0 to 40 cm™ at 
1.2°K in the metallic and localized regimes. The correlation between ¢(7') and 
o(w) in the localized regime suggests that the drop in conductivity at low electron 
concentrations is caused by the appearance of a gap at the Fermi level. 


Elasticity Measurements in the Layered Dichalcogenides TaSe. and NbSe.. M. 
Barmatz, L. R. Testardi, and F. J. Di Salvo, Phys. Rev. B, 12 (November 15, 1975), 
pp. 4867-4376. The Young’s modulus and internal friction exhibit large anomalies 
at the commensurate charge-density wave (cpwW) transition in 2H-TaSe.. Hysteresis 
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effects (~5K) verify the first-order nature of this transition. The incommensurate 
cDW transitions and the superconducting transition in 2H-NbSe. show weak elastic 
anomalies with essentially no hysteresis effects. 


Interdiffusions in Thin-Film Au on Pt On GaAs (100) Studied with Auger Spectros- 
copy. C. C. Chang, S. P. Murarka, V. Kumar, and G. Quintana, J. Appl. Phys., 
46 (October 1975), pp. 4237-4243. Pt/GaAs heated in vacuum reacted initially 
by rapid Ga migration into Pt and formation of an As-rich layer at the Pt/GaAs 
interface. Ga eventually traveled entirely through even 9000A Pt films, while As 
always stopped abruptly about 3 way into the Pt. No Au was detected (<1 atom 
percent) in the Pt or GaAs after extensive Pt-GaAs reaction in Au/Pt/GaAs. Pt/ 
GaAs heated in air behaved similarly, but developed a Ga-O layer over the Pt and 
an oxygen-rich layer at the Pt/GaAs interface. 


Low-Threshold Room-Temperature Double-Heterostructure GaAs,_,Sb,/Al,Gai_,- 
Asi_;Sb;z Injection Lasers at l-um Wavelengths. R. E. Nahory and M. A. Pollack, 
Appl. Phys. Letters, 27 (November 15, 1975), pp. 562-564. Double-hetero- 
structure (DH) injection lasers based on the GaAs)_,Sbz/Al,Ga:_,Asi_2Sb, system 
have been fabricated using liquid phase epitaxial growth techniques and operated 
at room temperature at wavelengths in the l-~m region. The observed room-tempera- 
ture threshold current densities, as low as 2100 A cm~, are comparable to those of 
GaAs/AlGaAs devices of similar geometry. 


Observation of Resonance Radiation Pressure on an Atomic Vapor. J. EK. Bjorkholm, 
A. Ashkin, and D. B. Pearson, Appl. Phys. Letters, 27 (November 15, 1975), pp. 
034-537. We have used the resonance radiation pressure from 40 mW of cw 
dye laser light propagating axially down a tube filled with sodium vapor to increase 
the sodium pressure (density) up to 50 percent over a length of 20 cm. The magni- 
tude of the effect agrees well with measurements of the absorbed power. 


Optical Pumping in Nitrogen Doped GaP. R. F. Leheny and Jagdeep Shah, Phys. 
Rev. B, 12 (October 15, 1975), pp. 3268-3274. Absorption saturation at the A 
bound exciton in GaP:N is described for a pulsed pump laser tuned directly to this 
absorption line and for a pump laser tuned above the indirect absorption edge. The 
second measurement yields 10-percent capture efficiency for N impurity. These 
measurements are analyzed by a model three-level system for the bound exciton by 
states. 


Physical Properties of Poly(vinylchloride)-Copolyester Thermoplastic Elastomer 
Mixtures. T. Nishi, T. K. Kwei, and T. T. Wang, J. Appl. Phys., 46 (October 1975), 
pp. 4157-4165. A study was made on the compatibility, thermal behavior, 
and mechanical properties of the poly(vinylchloride) blended with copolyester 
thermoplastic elastomer. Results from Nmr, thermal expansion, tensile test, and 
dynamic mechanical measurements indicate extensive mixing of the segments of two 
polymers. 


Torsional-Mode Losses at Contacts Between Homogeneous Fiber Waveguides and 
Supporting Structures. R. L. Rosenberg and G. D. Boyd, J. Appl. Phys., 46 (Novem- 
ber 1975), pp. 4654-4658. The losses from an ultrasonic torsional wave in a 
homogeneous fiber that are caused by contacts with fiber supports are found to de- 
pend primarily on contact area for a wide range of contact forces and materials. The 
associated force, compliance, and frequency dependencies are used to evaluate 
long-waveguide potentialities. 


Volume Holograms in Photochromic Materials. W. J. Tomlinson, Appl. Opt., 14 
(October 1975), pp. 2456-2467. Theoretical expressions are derived describing 
the process of writing volume (or thick) hologram gratings in photochromic materials. 
The theory includes the effects of the saturation of the material response, scattering 
of the writing beams by the partially written hologram, and the refractive index 
changes that accompany the photoinduced absorption changes. 
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